β0 + β1xi and want to estimate the unknown
|
|
- Dwight Davis
- 5 years ago
- Views:
Transcription
1 SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal on the s) OLS estmators are unbased! (under SLR.-SLR.4) but B s not alone OLS estmators have a varance SLR.5 - Homoskedastcty MSE/RMSE (Goodness of Ft) and Standard Errors OLS estmators are BLUE! (under SLR.-SLR.5) (separate handout) Those OLS Estmates ) Recall the brth of OLS estmates: a) You have a dataset consstng of n observatons of (, ) y: { }, y =,,... n. b) You beleve that ecept for random nose n the data, there s a lnear relatonshp between the s and the y s: y β + β and want to estmate the unknown parameters β (ntercept parameter) and β (slope parameter). c) Adoptng OLS, you estmate β and β by mnmzng sum squared resduals (SSRs): mn SSR = ( y ( )) β + β wrt β and β d) For the gven sample, the OLS estmates of the unknown ntercept and slope parameters are: ) Slope: ˆ ( )( y y) ( ) y y y y β = = = w, where ( ( n ) S ( w = and w = so the w ' s ( n ) S sum to and are proportonal to the square of the -dstance from. y y ) Recall that s the slope of the lne connectng (, y ) to the sample means pont, (, y ). ) Intercept: ˆ β ˆ = y β.
2 SLR Models Estmaton Estmates (e post) v. Estmators (e ante) ) epost (actual; after the event): After the data set s generated, OLS provdes numerc estmates of the slope and ntercept parameters, for the gven dataset (estmates are numbers, not random varables). a) After we have drawn the sample {, y } ) Slope estmate: ˆ ( )( y y) β =, and ( ) Intercept estmate: ˆ β ˆ = y β., we have the OLS estmates: 3) eante (before the event): But pror to the generaton of the data, the s and y s are random varables, X s and Y s, and OLS provdes a rule for estmatng the OLS coeffcents (for any realzed data set). a) We call these rules estmators. Estmators wll take on dfferent values dependng on the actual drawn sample, the actual 's and y's. Accordngly, estmators are random varables. b) The X ' s and Y ' s are random varables, and OLS provdes us wth slope and ntercept estmators: ( X X)( Y Y) ( X X) Y () Slope estmator: B = = ( X X) ( X X) () Intercept estmator: B = Y BX j j 4) To revew notaton, we have: a) Random varables (upper case letters): X's and Y's b) Data (lower case letters): 's and y's c) True parameters: β and β d) Parameter estmators (random varables; upper case letters): B and B e) Parameter estmates (estmated coeffcents): ˆ β ˆ and β
3 SLR Models Estmaton The Smple Lnear Regresson (SLR) Condtons -4 5) SLR. Lnear model (DGM): Y = β + βx + U, where X, Y and U are random varables and β and β are unknown parameters to be estmated. a) Ths s sometmes referred to as the Data Generaton Mechansm (DGM), as t descrbes the process by whch the data are assumed to have been generated. b) Notce that X, U and Y are now random varables, reflectng the random nature of the DGM. c) U s the uneplaned (or unobserved) error term (or dsturbance), and captures other factors (ecluded from the model) that eplan Y: ) = β β U Y X ) Put dfferently: U s the part of Y not eplaned/generated by the lnear functon of X. 6) SLR. Random samplng: the sample {(, )} y s a random sample; the th elements n the sample, (, y ), s the realzaton of two random varables ( X, Y ), where Y = β + β X + U. 7) SLR.3 Sample varaton n the ndependent varable: the ' s are not all the same value 8) SLR.4 U has zero condtonal mean: EU ( X= ) = for all a) EU ( X= ) = for any mples that: ) EU ( ) = (U has mean zero) () If the epected value of U s condtonal on any value of, then the overall epected value of U, whch wll be a weghted average of the condtonal epectatons of U, wll also be. () Put dfferently: E( U ) = prob( X = ) E( U X = ) = prob( X = ) = ) Cov( X, U ) = (X and U are uncorrelated) () Cov( X, U) E( ( X µ X)( U µ U) ) E( ( X µ X) U) U = E ( XU ) µ E ( U ) = E ( XU ) = prob( X = ) E( U X = ) = = snce µ = X = prob( X = ) E( U X = ) = prob( X = ) = At tmes we wll consder the X values to be eogenously gven, n whch case the eplanatory varable s not random. Recall that f X and U are ndependent then Cov( X, U ) =. A covarance of, however, does not mply ndependence, but rather than X and U do not move together n much of a lnear way. 3
4 SLR Models Estmaton () Notce the connecton to Omtted Varable Bas, whch s drven by correlaton between U and X. An Asde: The Populaton Regresson Functon 9) Under these assumptons (specfcally SLR. and SLR.4): a) β β β β EY ( X= ) = + + EU ( ) = + +, so the epected value of Y gven s EY ( X= ) = β + β. ) Populaton Regresson Functon (PRF): EY ( X= ) = β + β a) Ths traces out the condtonal means (condtonal on the values of X, the partcular values of the RHS varable) of the dependent varable Y. B and B are Lnear Estmators (condtonal on the s) ) The OLS slope estmator, B, s lnear n the Y ' s (condtonal on the s), snce we can epress the estmator as: ( ) ( ) a) B = by, where b = = ( ) ( n ) S j b) Note that condtonal on the s means that we are takng the values as gven, and not as random varables wth values to be determned. ) And the OLS ntercept estmator s also lnear n the Y ' s (condtonal on the s) snce: a) B = Y by = b Y n n 3) So condtonal on the 's, B and B are lnear estmators. 4
5 SLR Models Estmaton OLS estmators are unbased! (under SLR.-SLR.4) Who saw ths comng? 4) Gven assumptons/condtons SLR.-SLR.4, B and B, the OLS estmators of the ntercept and slope parameters, are unbased estmators (so for each, the epected value of the estmator s the true parameter value). a) We'll be provng ths below. b) The trck n the proof s to assume a partcular set of sample ' s, and to show that for any such sample, the OLS estmators wll be unbased. And snce ths s true for any sample of ' s, t must be true n epectaton. ) Ths s sometmes referred to as the Law of Iterated Epectaton. We wll skp the proof of ths Law but the ntuton s pretty straghtforward, yes? and you saw t n acton above n the proof that EU ( ) = gven SLR.4. 5) Condtonal on the s, the OLS estmators (random varables note the captal B's below) are defned by: a) ( )( Y Y) ( )( Y Y) ( ) Y Y B = = =, ( ) ( n ) S ( n ) S ( Y Y) and so B = w, ( ) where w ( = ( n ) S are non-negatve weghts that sum to, w =. b) B = Y B 6) An nterestng result: a) Assume SLR.-SLR.4. ) Then Y = β + βx + U, and µ Y = β + βµ X (snce EU ( ) = ) ) β β β β Cov( X, Y ) = Cov( X, + X + U ) = Cov( X, X ) + Cov( X, U ) = Cov( X, X ) snce Cov( X, U ) =. Cov( X, Y ) Cov( X, Y ) ) But then β =. and β = µ βµ = µ µ. Cov( X, X ) Y X Y Cov( X, X ) X b) Notce the resemblance to the OLS estmators! 5
6 SLR Models Estmaton 7) The OLS slope estmator B s unbased! - E( B ) = β Y Y a) Step - E = β: To evaluate the epected value of B condtonal on the s, we Y Y need to determne E, for each. But E( Y ) = β + β + EU ( ) = β + β (gven SLR.4). And snce EY ( s ' ) = EY ( ) = ( β + β) n n = β + β, we have: Y Y ( β + β ) ( β + β) β( ) E = = = β. ( ) ( ) b) Step - ( ' ) E B s = β ( B n an unbased estmator of β, condtonal on the s): Y Y Y Y E B ' s = E w = we = wβ = β weghts sum to w = ). ) Snce ( ) (snce the c) Step 3 - E( B ) = β : And snce E( B s ' ) = β for all s, E( B ) = β. 3 8) The OLS ntercept estmator B s also unbased! - E( B ) a) Step - ( ' ) = β E B s = β ( B n an unbased estmator of β, condtonal on the s): ( ' ) ( ) ( ) E B s = E Y E B = β + β β = β. b) Step - E( B ) = β : And snce E( B s ' ) = β for all s, E( B ) = β. 9) OLS LUE (gven SLR.-SLR.4): So gven the SLR condton -4, the OLS slope and ntercept estmators are lnear unbased estmators (LUEs) of the unknown parameter values! 4 ) Who saw ths comng? Who ever thought that process of mnmzng SSRs would lead to unbased estmators? 3 Ths last step s an applcaton of the Law of Iterated Epectatons. 4 But remember that they are only lnear condtonal on the 's. 6
7 SLR Models Estmaton But B s not alone!!! there are an nfnte number of unbased slope estmators (gven SLR.-SLR.4) ) Any weghted average of the slopes of the lnes connectng the dataponts to the samples means wll also be a LUE of the slope parameter: a) Consder the estmator defned by Y Y α X X, where α =. b) Then condtonal on the s: E Y Y Y Y α = αe = αβ = β, snce α =. c) And snce ths s the case for all s, we have an unbased estmator of β. d) Snce we only requre that the α ' s sum to one, we have an nfnte number of unbased slope estmators (as we vary the α ' s ). ) Test your understandng! From before, you know that gven SLR.-SLR.4, E Y β β EY s ' = β β +. Use these results to show that each of the ( ) = + and ( ) followng wll be unbased slope estmators, condtonal on the 's. And accordngly, by the Law of Iterated Epectatons, unbased slope estmators overall: Y Y a) B = X X 's. Answer: E( B s ' ) 5 b).5 Y Y B.5 Y Y = + X X X5 X 5 c).9 Y Y B. Y Y = + X X X5 X 5 d).5 Y Y B.5 Y Y = X X X5 X Y Y B = 5 e) X X5 Y Y Y Y B = f) X X5 X3 X7 ( ) ( ) β + β β + β β ( = = = β, all ( ) ( ) 3) And so gettng to BLUE (Best Lnear Unbased Estmators) wll be all about fndng the LUE(s?) (amongst the many) wth the mnmum varance. 7
8 SLR Models Estmaton OLS estmators (B and B ) have varances 4) Varances of the OLS estmators: Yes, because they are estmators, the OLS estmators, B and B, are random varables, wth a jont dstrbuton, means, varances and a covarance. The sample you are workng wth s just one of many possble samples that you could have drawn. 5) An eample: Y = +.5X + U, X Unform[,] and U N(,). a) The followng show the results from, samples, each wth observatons generated by the random process above wth one slope and ntercept estmate per sample. Dstrbuton of OLS ntercept and slope estmates. summ best best Varable Obs Mean Std. Dev. Mn Ma best, best, Densty b est. Densty b est. 6) The means of the, estmates are qute close to the true parameters values but notce the large varaton n slope and ntercept estmates, drven by the random nature of the DGM and dependng on the partcular sample that you are workng wth. 7) Worth repeatng!!!: Because they are estmators, the OLS estmators B and B are random varables, wth a jont dstrbuton, means, varances, and a covarance. Dfferent samples wll generate dfferent ntercept and slope estmates. Who knows f your sample s representtve? your estmates could n fact be not at all close to the true parameter values. It all depends on your sample. 8
9 SLR Models Estmaton SLR.5 Homoskedastcty 8) SLR.5: Homoskedastcty (constant condtonal varance of the error term) a) To derve the varances of the estmators, we make one addtonal assumpton: SLR.5: Var( U X ) σ = = for all b) SLR.5 holds f U s ndependent of X, so that Var( U X = ) = Var( U ) = σ. c) Heteroskedastcty: the condtonal varances are not all the same. Eample: Newton real estate sales prces and lot szes (heteroscedastcty) Source SS df MS Number of obs = F(, 8) = 69.4 Model.374e+3.374e+3 Prob > F =. Resdual 5.4e e+ R-squared = Adj R-squared =.943 Total 6.776e e+ Root MSE = 4.e prce Coef. Std. Err. t P> t [95% Conf. Interval] lotsze _cons e+6.e+6 3.e LotSze Prce Ftted values Resduals LotSze predcteds v. actuals resduals v. lot sze 9
10 SLR Models Estmaton A smple test for heteroskedastcty: Regress the squared resduals on the RHS varable. Are there more complcated test? Of course!. predct resd, res. gen resd=resd^. reg resd lotsze Source SS df MS Number of obs = F(, 8) = 43.3 Model e e+4 Prob > F =. Resdual 4.89e e+3 R-squared = Adj R-squared =.93 Total 4.8e e+3 Root MSE = 3.9e resd Coef. Std. Err. t P> t [95% Conf. Interval] lotsze 3.3e e e+7 _cons -.57e+ 5.59e e e Varance of the OLS Estmators (assumng SLR.-SLR.5) 9) If SLR.5 holds, n addton to SLR.-SLR.4, then we have the followng varances of the : OLS estmators, condtonal on the partcular sample of { } a) b) Var( B ) = Var( B ) σ ( j σ = n ( j and StdDev B sd B Var B ( ) = ( ) = ( ) = 3) Here s the proof for the varance of the slope estmator: σ ( ( a) From above we have B = ( Y = α Y, where α ( n ) S =. ( n ) S b) Snce the Y ' s are ndependent, the varance of the sum s the sum of the varances, and Var( B ) = Var( αy ) = αvar( Y ) = ασ = σ α c) But ( α = ( n ) S. and so
11 SLR Models Estmaton ( j [( n ) S ] [( n ) S ] ( ) ( n ) S α = = = = ( n ) S ( ) σ σ d) Therefore: Var( B ) = = ( ) ( n ) S j j ) Note that ths ncreases wth ncreases n the error varance, σ, and wth decreases n the varaton of the ndependent varable. Makes sense? ) Where does ths varance come from? The estmator s always just the OLS estmator, so all of the varaton s comng from the dfferent possble data samples generated by the DGM. (See the Ecel smulatons.) MSE/RMSE (Goodness of Ft) and Standard Errors 3) Mean Squared Error (MSE): Typcally, we don t know the actual value of the varance σ. SSR But we can estmate t wth the: ˆ σ = = MSE. n a) Recall that MSE was one of our Goodness of Ft metrcs n OLS/SLR Assessment. b) Under SLR.-SLR.5 and condtonal on the s, MSE = σˆ wll be an unbased estmator of the varance, σ, of the error term U (the homoskedastc error). 5 MSE 3) s an unbased estmator of Var( B ) ( n ) S a) Snce ˆ σ = MSE s an unbased estmator of σ and snce MSE MSE = n S ( ) ( ) s an unbased estmator of Var( B ). Var( B ) = σ ( 33) RMSE: The standard error of the regresson, sometme called the Root MSE (or RMSE), s SSR the square root of ths: ˆ σ = = MSE = RMSE. n a) If we have RMSE = ˆ σ, then we can calculate the standard error of B : ˆ σ RMSE RMSE ( ) = ( ) = = =. S n ) StdErr B se B ( ) ( ) b) Ths s an estmate of StdDev( B) = sd( B), and s useful for constructng confdence ntervals for, and testng hypotheses about, β, the true slope parameter n the DGM. And now you see where that std. err. formula came from n OLS/SLR Assessment!, 5 For the proof, see the tet.
β0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationChapter 14 Simple Linear Regression
Chapter 4 Smple Lnear Regresson Chapter 4 - Smple Lnear Regresson Manageral decsons often are based on the relatonshp between two or more varables. Regresson analss can be used to develop an equaton showng
More informationDepartment of Quantitative Methods & Information Systems. Time Series and Their Components QMIS 320. Chapter 6
Department of Quanttatve Methods & Informaton Systems Tme Seres and Ther Components QMIS 30 Chapter 6 Fall 00 Dr. Mohammad Zanal These sldes were modfed from ther orgnal source for educatonal purpose only.
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More informationStatistics for Business and Economics
Statstcs for Busness and Economcs Chapter 11 Smple Regresson Copyrght 010 Pearson Educaton, Inc. Publshng as Prentce Hall Ch. 11-1 11.1 Overvew of Lnear Models n An equaton can be ft to show the best lnear
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationBiostatistics 360 F&t Tests and Intervals in Regression 1
Bostatstcs 360 F&t Tests and Intervals n Regresson ORIGIN Model: Y = X + Corrected Sums of Squares: X X bar where: s the y ntercept of the regresson lne (translaton) s the slope of the regresson lne (scalng
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationOutline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.
Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationProperties of Least Squares
Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationSystems of Equations (SUR, GMM, and 3SLS)
Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationChapter 3. Two-Variable Regression Model: The Problem of Estimation
Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that
More informationTopic 7: Analysis of Variance
Topc 7: Analyss of Varance Outlne Parttonng sums of squares Breakdown the degrees of freedom Expected mean squares (EMS) F test ANOVA table General lnear test Pearson Correlaton / R 2 Analyss of Varance
More informationY = β 0 + β 1 X 1 + β 2 X β k X k + ε
Chapter 3 Secton 3.1 Model Assumptons: Multple Regresson Model Predcton Equaton Std. Devaton of Error Correlaton Matrx Smple Lnear Regresson: 1.) Lnearty.) Constant Varance 3.) Independent Errors 4.) Normalty
More informationPubH 7405: REGRESSION ANALYSIS. SLR: INFERENCES, Part II
PubH 7405: REGRESSION ANALSIS SLR: INFERENCES, Part II We cover te topc of nference n two sessons; te frst sesson focused on nferences concernng te slope and te ntercept; ts s a contnuaton on estmatng
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More information17 - LINEAR REGRESSION II
Topc 7 Lnear Regresson II 7- Topc 7 - LINEAR REGRESSION II Testng and Estmaton Inferences about β Recall that we estmate Yˆ ˆ β + ˆ βx. 0 μ Y X x β0 + βx usng To estmate σ σ squared error Y X x ε s ε we
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationStatistics MINITAB - Lab 2
Statstcs 20080 MINITAB - Lab 2 1. Smple Lnear Regresson In smple lnear regresson we attempt to model a lnear relatonshp between two varables wth a straght lne and make statstcal nferences concernng that
More information18. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III US Domestc Beers: Calores vs. % Alcohol Ftted Values and Resduals To each observed x, there corresponds a y-value on the ftted lne, y ˆ ˆ = α + x. The are called ftted values.
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 31 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 6. Rdge regresson The OLSE s the best lnear unbased
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationLearning Objectives for Chapter 11
Chapter : Lnear Regresson and Correlaton Methods Hldebrand, Ott and Gray Basc Statstcal Ideas for Managers Second Edton Learnng Objectves for Chapter Usng the scatterplot n regresson analyss Usng the method
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationChapter 5: Hypothesis Tests, Confidence Intervals & Gauss-Markov Result
Chapter 5: Hypothess Tests, Confdence Intervals & Gauss-Markov Result 1-1 Outlne 1. The standard error of 2. Hypothess tests concernng β 1 3. Confdence ntervals for β 1 4. Regresson when X s bnary 5. Heteroskedastcty
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More information) is violated, so that V( instead. That is, the variance changes for at least some observations.
Econ 388 R. Butler 014 revsons Lecture 15 I. HETEROSKEDASTICITY: both pure and mpure (the mpure verson s due to an omtted regressor that s correlated wth the ncluded regressors n the model) A. heteroskedastcty=when
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More information28. SIMPLE LINEAR REGRESSION III
8. SIMPLE LINEAR REGRESSION III Ftted Values and Resduals US Domestc Beers: Calores vs. % Alcohol To each observed x, there corresponds a y-value on the ftted lne, y ˆ = βˆ + βˆ x. The are called ftted
More informationLab 4: Two-level Random Intercept Model
BIO 656 Lab4 009 Lab 4: Two-level Random Intercept Model Data: Peak expratory flow rate (pefr) measured twce, usng two dfferent nstruments, for 17 subjects. (from Chapter 1 of Multlevel and Longtudnal
More informationT E C O L O T E R E S E A R C H, I N C.
T E C O L O T E R E S E A R C H, I N C. B rdg n g En g neern g a nd Econo mcs S nce 1973 THE MINIMUM-UNBIASED-PERCENTAGE ERROR (MUPE) METHOD IN CER DEVELOPMENT Thrd Jont Annual ISPA/SCEA Internatonal Conference
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationChapter 4: Regression With One Regressor
Chapter 4: Regresson Wth One Regressor Copyrght 2011 Pearson Addson-Wesley. All rghts reserved. 1-1 Outlne 1. Fttng a lne to data 2. The ordnary least squares (OLS) lne/regresson 3. Measures of ft 4. Populaton
More informationIntroduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors
ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationRegression Analysis. Regression Analysis
Regresson Analyss Smple Regresson Multvarate Regresson Stepwse Regresson Replcaton and Predcton Error 1 Regresson Analyss In general, we "ft" a model by mnmzng a metrc that represents the error. n mn (y
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More informationEcon107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)
I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,
More informationBiostatistics. Chapter 11 Simple Linear Correlation and Regression. Jing Li
Bostatstcs Chapter 11 Smple Lnear Correlaton and Regresson Jng L jng.l@sjtu.edu.cn http://cbb.sjtu.edu.cn/~jngl/courses/2018fall/b372/ Dept of Bonformatcs & Bostatstcs, SJTU Recall eat chocolate Cell 175,
More informationCorrelation and Regression
Correlaton and Regresson otes prepared by Pamela Peterson Drake Index Basc terms and concepts... Smple regresson...5 Multple Regresson...3 Regresson termnology...0 Regresson formulas... Basc terms and
More informationNow we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity
ECON 48 / WH Hong Heteroskedastcty. Consequences of Heteroskedastcty for OLS Assumpton MLR. 5: Homoskedastcty var ( u x ) = σ Now we relax ths assumpton and allow that the error varance depends on the
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationProfessor Chris Murray. Midterm Exam
Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.
More informationIf we apply least squares to the transformed data we obtain. which yields the generalized least squares estimator of β, i.e.,
Econ 388 R. Butler 04 revsons lecture 6 WLS I. The Matrx Verson of Heteroskedastcty To llustrate ths n general, consder an error term wth varance-covarance matrx a n-by-n, nxn, matrx denoted as, nstead
More informationThe SAS program I used to obtain the analyses for my answers is given below.
Homework 1 Answer sheet Page 1 The SAS program I used to obtan the analyses for my answers s gven below. dm'log;clear;output;clear'; *************************************************************; *** EXST7034
More informationInterpreting Slope Coefficients in Multiple Linear Regression Models: An Example
CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 14 Multiple Regression Models
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 14 Multple Regresson Models 1999 Prentce-Hall, Inc. Chap. 14-1 Chapter Topcs The Multple Regresson Model Contrbuton of Indvdual Independent Varables
More informationLecture 3 Specification
Lecture 3 Specfcaton 1 OLS Estmaton - Assumptons CLM Assumptons (A1) DGP: y = X + s correctly specfed. (A) E[ X] = 0 (A3) Var[ X] = σ I T (A4) X has full column rank rank(x)=k-, where T k. Q: What happens
More information4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA
4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected
More informationSTAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).
(out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0
More informationProblem of Estimation. Ordinary Least Squares (OLS) Ordinary Least Squares Method. Basic Econometrics in Transportation. Bivariate Regression Analysis
1/60 Problem of Estmaton Basc Econometrcs n Transportaton Bvarate Regresson Analyss Amr Samm Cvl Engneerng Department Sharf Unversty of Technology Ordnary Least Squares (OLS) Maxmum Lkelhood (ML) Generally,
More informationRockefeller College University at Albany
Rockefeller College Unverst at Alban PAD 705 Handout: Maxmum Lkelhood Estmaton Orgnal b Davd A. Wse John F. Kenned School of Government, Harvard Unverst Modfcatons b R. Karl Rethemeer Up to ths pont n
More informationTHE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 6 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutons to assst canddates preparng for the eamnatons n future years and for
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationNANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION MTH352/MH3510 Regression Analysis
NANYANG TECHNOLOGICAL UNIVERSITY SEMESTER I EXAMINATION 014-015 MTH35/MH3510 Regresson Analyss December 014 TIME ALLOWED: HOURS INSTRUCTIONS TO CANDIDATES 1. Ths examnaton paper contans FOUR (4) questons
More information2016 Wiley. Study Session 2: Ethical and Professional Standards Application
6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton
More informationHere is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)
Secton 1.5 Correlaton In the prevous sectons, we looked at regresson and the value r was a measurement of how much of the varaton n y can be attrbuted to the lnear relatonshp between y and x. In ths secton,
More informationSTAT 511 FINAL EXAM NAME Spring 2001
STAT 5 FINAL EXAM NAME Sprng Instructons: Ths s a closed book exam. No notes or books are allowed. ou may use a calculator but you are not allowed to store notes or formulas n the calculator. Please wrte
More informationNegative Binomial Regression
STATGRAPHICS Rev. 9/16/2013 Negatve Bnomal Regresson Summary... 1 Data Input... 3 Statstcal Model... 3 Analyss Summary... 4 Analyss Optons... 7 Plot of Ftted Model... 8 Observed Versus Predcted... 10 Predctons...
More informationSee Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)
Count Data Models See Book Chapter 11 2 nd Edton (Chapter 10 1 st Edton) Count data consst of non-negatve nteger values Examples: number of drver route changes per week, the number of trp departure changes
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationThe Gaussian classifier. Nuno Vasconcelos ECE Department, UCSD
he Gaussan classfer Nuno Vasconcelos ECE Department, UCSD Bayesan decson theory recall that we have state of the world X observatons g decson functon L[g,y] loss of predctng y wth g Bayes decson rule s
More informationProbability and Random Variable Primer
B. Maddah ENMG 622 Smulaton 2/22/ Probablty and Random Varable Prmer Sample space and Events Suppose that an eperment wth an uncertan outcome s performed (e.g., rollng a de). Whle the outcome of the eperment
More informationA Bound for the Relative Bias of the Design Effect
A Bound for the Relatve Bas of the Desgn Effect Alberto Padlla Banco de Méxco Abstract Desgn effects are typcally used to compute sample szes or standard errors from complex surveys. In ths paper, we show
More informationParametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010
Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton
More informationChapter 14 Simple Linear Regression Page 1. Introduction to regression analysis 14-2
Chapter 4 Smple Lnear Regresson Page. Introducton to regresson analyss 4- The Regresson Equaton. Lnear Functons 4-4 3. Estmaton and nterpretaton of model parameters 4-6 4. Inference on the model parameters
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationA Comparative Study for Estimation Parameters in Panel Data Model
A Comparatve Study for Estmaton Parameters n Panel Data Model Ahmed H. Youssef and Mohamed R. Abonazel hs paper examnes the panel data models when the regresson coeffcents are fxed random and mxed and
More informationJAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger
JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More informationCIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M
CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute
More information