Interpreting Slope Coefficients in Multiple Linear Regression Models: An Example
|
|
- Elinor Glenn
- 6 years ago
- Views:
Transcription
1 CONOMICS 5* -- Introducton to NOT CON 5* -- Introducton to NOT : Multple Lnear Regresson Models Interpretng Slope Coeffcents n Multple Lnear Regresson Models: An xample Consder the followng smple lnear regresson model for the brth weght of newborn babes gven by the followng populaton regresson equaton (PR): bwght β + β cgs + u () where the observable varables are defned as follows: bwght brth weght of newborn baby born to mother, n grams; cgs average number of cgarettes smoked per day durng pregnancy by mother. Interpretaton of slope coeffcent β on explanatory varable cgs n smple regresson model (): d ( bwght cgs ) d cgs d ( β + βcgs ) d cgs β unadjusted margnal effect of cgs on mean brth weght of newborn babes the change n mean brth weght of newborn babes, n grams, assocated wth an ncrease n mother s cgarette consumpton durng pregnancy of one cgarette per day CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
2 CONOMICS 5* -- Introducton to NOT Consder the followng multple lnear regresson model for the brth weght of newborn babes gven by the followng populaton regresson equaton (PR): bwght β + β cgs + β famnc + β male + β whte + u () where the new explanatory varables are defned as follows: fa mnc annual famly ncome of mother, n thousands of 988 dollars per year; male f newborn baby of mother s male, otherwse; whte f mother s whte, otherwse. Interpretaton of slope coeffcent β on explanatory varable cgs n multple regresson model (): Let x be the 5 row vector of regressor values for observaton : [ cgs famnc male whte ] ( bwght x ) cgs ( β + β cgs + βfamnc + βmale cgs + β whte ) x. adjusted (partal) margnal effect of cgs on condtonal mean brth weght of newborn babes the change n condtonal mean brth weght of newborn babes, n grams, assocated wth an ncrease n mother s daly cgarette consumpton durng pregnancy of one cgarette, holdng constant the famly ncome and race of the mother and the sex of the newborn chld the change n condtonal mean brth weght of newborn babes, n grams, assocated wth an ncrease n mother s daly cgarette consumpton durng pregnancy of one cgarette, for newborns of the same sex whose mothers have the same famly ncome and are of the same race β CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
3 CONOMICS 5* -- Introducton to NOT Compare the slope coeffcent β n Model and Model Model s the smple lnear regresson model gven by populaton regresson equaton (.) and the correspondng populaton regresson functon (.): bwght β + β cgs + u (.) ( bwght cgs ) β + βcgs (.) Model s the multple lnear regresson model gven by populaton regresson equaton (.) and the correspondng populaton regresson functon (.): bwght β + β cgs + β famnc + β male + β whte + u (.) ( bwght cgs, famnc, male, whte ) β + βcgs + βfamnc + βmale + βwhte (.) Queston: How does the slope coeffcent β n the smple lnear regresson model gven by equatons (.) and (.) dffer from the slope coeffcent β n the multple lnear regresson model gven by equatons (.) and.)? CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
4 CONOMICS 5* -- Introducton to NOT Analytcal Answer The slope coeffcent β n the smple lnear regresson model gven by equatons (.) and (.) s the unadjusted or total margnal effect of cgarette consumpton on mean brth weght, because PR (.) and PRF (.) do not account for, or control for, the effects on brth weght of any other explanatory varables apart from cgs. Analytcally, ths means that the slope coeffcent β n the smple lnear regresson model (.)/ (.) corresponds to the total dervatve of mean brth weght wth respect to cgs : d ( bwght cgs ) d cgs d ( β + β cgs ) β n Model d cgs the unadjusted or total margnal effect of cgs on the mean brth weght of newborns the change n mean brth weght, n grams, assocated wth a -cgarette-per-day ncrease n daly cgarette consumpton of the mother durng pregnancy CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
5 CONOMICS 5* -- Introducton to NOT In contrast, the slope coeffcent β n the multple lnear regresson model gven by equatons (.) and (.) s the adjusted or partal margnal effect of cgarette consumpton on mean brth weght, because PR (.) and PRF (.) account for, or control for, the effect on brth weght of other explanatory varables apart from cgs, namely famly ncome (famnc ), sex of the newborn (male ), and race of the mother (whte ). Analytcally, ths means that the slope coeffcent β n the multple lnear regresson model (.)/ (.) corresponds to the partal dervatve of mean brth weght wth respect to cgs : ( bwght cgs, famnc, male, whte, mpg ) cgs (β + β cgs + βfamnc + βmale cgs the adjusted or partal margnal effect of cgs on the mean brth weght of newborns + βwhte) β n Model the change n condtonal mean brth weght, n grams, assocated wth an ncrease of cgarette-perday n cgarette consumpton durng pregnancy, holdng constant famly ncome (famnc), the sex of the newborn (male), and the race of the mother (whte). the change n condtonal mean brth weght, n grams, assocated wth a -cgarette-per-day ncrease n cgarette consumpton durng pregnancy for mothers of the same famly ncome and race and newborns of the same sex. CON 5* -- Introducton to Note : The Multple Regresson Model Page 5 of 5 pages
6 CONOMICS 5* -- Introducton to NOT Interpretng the slope coeffcent estmate of cgs n Model Wrte the OLS sample regresson functon (SRF) for Model as bwg~ ht ~ ~ β + β cgs (.) ~ where β j denotes the OLS estmate of β j n Model, and bwg ~ ht s the OLS estmate of mean brth weght gven by the populaton regresson functon (PRF) bwght cgs β + β cgs for Model, the smple lnear regresson model gven by PR (.) and PRF (.). ( ) The OLS SRF (.) for Model mples that the estmated change n mean brth weght assocated wth a change n cgarette consumpton cgs of Δ cgs s ~ Δ bwg~ ht βδcgs (.) In Model, the estmated effect on mean brth weght of a -cgarette-per-day ncrease n a mother s cgarette consumpton durng pregnancy can be obtaned by settng Δcgs n equaton (.): Δ bwg~ ~ ht β when Δ cgs (.5) ~ The slope coeffcent estmate β n Model s therefore an estmate of the change n mean brth weght assocated wth a -cgarette-per-day ncrease n cgs, holdng constant no other explanatory varables that may be related to brth weght. CON 5* -- Introducton to Note : The Multple Regresson Model Page 6 of 5 pages
7 CONOMICS 5* -- Introducton to NOT Interpretng the slope coeffcent estmate of cgs n Model Wrte the OLS sample regresson functon (SRF) for Model, obtaned by OLS estmaton of the multple lnear regresson equaton (.), as bwĝht βˆ cgs famnc male whte (.) where ˆβ j denotes the OLS estmate of β j n Model, and bwĝht s the OLS estmate of mean brth weght gven by the populaton regresson functon (PRF) for Model, the multple lnear regresson model gven by PR (.) and PRF (.). ( bwght cgs, famnc, male, whte ) β + βcgs + βfamnc + βmale + βwhte The OLS SRF (.) mples that the estmated change n mean brth weght assocated wth a change n daly cgarette consumpton cgs of Δ cgs and smultaneous changes n famly ncome of Δ famnc, n sex of the newborn of Δ male, and n race of the mother of Δ whte s Δbwĝht βˆ Δcgs famnc ˆ male ˆ Δ + βδ + β Δ whte (.) We can hold constant famly ncome, the sex of the newborn, and the race of the mother by settng Δ famnc, Δ male and Δ whte n equaton (.); the resultng change n estmated mean brth weght s then Δ bwĝht βˆ Δcgs when Δ famnc, Δ male and Δ whte (.5) CON 5* -- Introducton to Note : The Multple Regresson Model Page 7 of 5 pages
8 CONOMICS 5* -- Introducton to NOT In Model, the estmated effect on mean brth weght of a -cgarette-per-day ncrease n mother s cgarette consumpton durng pregnancy can be obtaned by settng Δ cgs n equaton (.5), or equvalently by settng Δ cgs, Δ famnc, Δ male and Δ whte n equaton (.): Δ bwĝht β ˆ when Δ cgs and Δ famnc, Δ male, and Δ whte (.6) The slope coeffcent estmate ˆβ n Model s therefore an estmate of the change n mean brth weght assocated wth a -cgarette-per-day ncrease n cgs, holdng constant famly ncome (famnc), the sex of the newborn (male), and the race of the mother (whte). The followng Stata exercse s desgned to llustrate the correct nterpretaton of the slope coeffcent estmate n the multple lnear regresson model, Model. It also llustrates the meanng of holdng constant other varables n multple lnear regresson models. These exercses ntroduce you to an mportant post-estmaton Stata command, the lncom command. ˆβ CON 5* -- Introducton to Note : The Multple Regresson Model Page 8 of 5 pages
9 CONOMICS 5* -- Introducton to NOT OLS stmaton of Models and Usng Stata OLS estmaton of the smple lnear regresson model for the brth weght of newborn babes gven by populaton regresson equaton () yelds the followng OLS sample regresson equaton: ~ ~ bwght + (*) β + β ~ cgs u Stata output for Model of OLS estmaton command regress:. regress bwght cgs Source SS df MS Number of obs F(, 86). Model Prob > F. Resdual R-squared Adj R-squared. Total Root MS bwght Coef. Std. rr. t P> t [95% Conf. Interval] cgs _cons CON 5* -- Introducton to Note : The Multple Regresson Model Page 9 of 5 pages
10 CONOMICS 5* -- Introducton to NOT OLS estmaton of the multple lnear regresson model for the brth weght of newborn babes gven by populaton regresson equaton () yelds the followng OLS sample regresson equaton: bwght βˆ cgs famnc male whte + û (*) Stata output for Model of OLS estmaton command regress:. regress bwght cgs famnc male whte Source SS df MS Number of obs F(, 8) 6.8 Model Prob > F. Resdual R-squared Adj R-squared.7 Total Root MS 56.9 bwght Coef. Std. rr. t P> t [95% Conf. Interval] cgs famnc male whte _cons CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
11 CONOMICS 5* -- Introducton to NOT Stata xercse: Model Queston: What s the effect on the mean brth weght of newborns of an ncrease n ther mothers cgarette consumpton durng pregnancy from to cgarettes per day (Δcgs ), whle holdng constant the mother s famly ncome at $, per year (famnc ), the sex of the newborn at male (male ), and the race of the mother at whte (whte )? Analytcal Answer: Compare the expressons mpled by Model for () the mean brth weght of newborns for whom cgs, famnc, male and whte and () the mean brth weght of newborns for whom cgs, famnc, male and whte. That s, compare and ( bwght cgs, famnc, male, whte ) β + β+ β + β + β (.) ( bwght cgs, famnc, male, whte ) β + β + β + β + β (.) Subtract the second functon from the frst functon: t s obvous that ths dfference s smply β : ( bwght cgs, famnc, male, whte ) ( bwght cgs, famnc, male, whte ) β + β + β + β + β β β β β ( ) β β β (.) CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
12 CONOMICS 5* -- Introducton to NOT Step : Use a Stata lncom command to compute for Model the estmated mean brth weght of a male newborn (for whom male ) who s born to a whte mother (for whom whte ) who smoked cgarettes per day durng pregnancy (for whom cgs ) and whose famly ncome s $, per year (famnc ),.e., to compute an estmate of the condtonal mean functon ( bwght cgs, famnc, male, whte ) β + β + β + β + β. Our estmate of ths condtonal mean functon can be wrtten as Ê ( bwght cgs, famnc, male, whte ) βˆ ˆ ˆ ˆ ˆ + β + β + β + β nter the Stata lncom command:.. lncom _b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]* ( ) cgs + famnc + male + whte + _cons bwght Coef. Std. rr. t P> t [95% Conf. Interval] () CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
13 CONOMICS 5* -- Introducton to NOT Step : Next, ncrease cgs by cgarette-per-day, from to, whle holdng constant famly ncome at a value of thousand dollars per year (famnc ), the sex of the newborn at male (male ), and the race of the mother at whte (whte ). Use another Stata lncom command to compute for Model the estmated mean brth weght of a male newborn (for whom male ) who s born to a whte mother (for whom whte ) who smoked cgarettes per day durng pregnancy (for whom cgs ) and whose famly ncome s $, per year (famnc ),.e., to compute an estmate of the condtonal mean functon ( bwght cgs, famnc, male, whte ) β + β+ β + β + β. Our estmate of ths condtonal mean functon can be wrtten as Ê ( bwght cgs, famnc, male, whte ) βˆ ˆ ˆ ˆ ˆ + β+ β + β + β nter the Stata lncom command:.. lncom _b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]* ( ) cgs + famnc + male + whte + _cons bwght Coef. Std. rr. t P> t [95% Conf. Interval] () CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
14 CONOMICS 5* -- Introducton to NOT Step : Fnally, use a Stata lncom command to compute the dfference between () the estmated mean brth weght of newborns for whom cgs, famnc, male and whte and () the estmated mean brth weght of newborns for whom cgs, famnc, male and whte,.e., to compute Ê ( bwght cgs, famnc, male, whte ) Ê( bwght cgs, famnc, male, whte ) βˆ βˆ βˆ ( βˆ ) βˆ βˆ βˆ βˆ β ˆ ˆβ ( ) nter on one lne the Stata lncom command:. lncom _b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]* - (_b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]*) ( ) cgs bwght Coef. Std. rr. t P> t [95% Conf. Interval] () CON 5* -- Introducton to Note : The Multple Regresson Model Page of 5 pages
15 CONOMICS 5* -- Introducton to NOT Result: Compare the output of the lncom command n Step wth the slope coeffcent estmate ˆβ for the regressor cgs produced by the regress command used to estmate Model by OLS. You wll see that they are dentcal.. lncom _b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]* - (_b[_cons] + _b[cgs]* + _b[famnc]* + _b[male]* + _b[whte]*) ( ) cgs bwght Coef. Std. rr. t P> t [95% Conf. Interval] () lncom _b[cgs] ( ) cgs bwght Coef. Std. rr. t P> t [95% Conf. Interval] () Result: The slope coeffcent estmate ˆβ of cgs n Model s an estmate of the change n mean brth weght of newborns assocated wth an ncrease of cgarette per day n the cgarette consumpton of mothers durng pregnancy (Δcgs ), whle holdng constant the other determnants of newborns brth weght, namely famly ncome (famnc), sex of the newborn (male), and race of the mother (whte). CON 5* -- Introducton to Note : The Multple Regresson Model Page 5 of 5 pages
Introduction to Dummy Variable Regressors. 1. An Example of Dummy Variable Regressors
ECONOMICS 5* -- Introducton to Dummy Varable Regressors ECON 5* -- Introducton to NOTE Introducton to Dummy Varable Regressors. An Example of Dummy Varable Regressors A model of North Amercan car prces
More informationECONOMICS 351* -- Stata 10 Tutorial 6. Stata 10 Tutorial 6
ECONOMICS 35* -- Stata Tutoral 6 Stata Tutoral 6 TOPICS: Functonal Form and Varable Re-scalng n Smple Lnear Regresson Models, and An Introducton to Multple Lnear Regresson Models DATA: auto.dta (a Stata-format
More informationMarginal Effects of Explanatory Variables: Constant or Variable? 1. Constant Marginal Effects of Explanatory Variables: A Starting Point
CONOMICS * -- NOT CON * -- NOT Margnal ffects of xplanatory Varables: Constant or Varable?. Constant Margnal ffects of xplanatory Varables: A Startng Pont Nature: A contnuous explanatory varable has a
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationECON 351* -- Note 23: Tests for Coefficient Differences: Examples Introduction. Sample data: A random sample of 534 paid employees.
Model and Data ECON 35* -- NOTE 3 Tests for Coeffcent Dfferences: Examples. Introducton Sample data: A random sample of 534 pad employees. Varable defntons: W hourly wage rate of employee ; lnw the natural
More informationTests of Exclusion Restrictions on Regression Coefficients: Formulation and Interpretation
ECONOMICS 5* -- NOTE 6 ECON 5* -- NOTE 6 Tests of Excluson Restrctons on Regresson Coeffcents: Formulaton and Interpretaton The populaton regresson equaton (PRE) for the general multple lnear regresson
More informationInterval Estimation in the Classical Normal Linear Regression Model. 1. Introduction
ECONOMICS 35* -- NOTE 7 ECON 35* -- NOTE 7 Interval Estmaton n the Classcal Normal Lnear Regresson Model Ths note outlnes the basc elements of nterval estmaton n the Classcal Normal Lnear Regresson Model
More informationMarginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients
ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Ordnary Least Squares (OLS): Smple Lnear Regresson (SLR) Analytcs The SLR Setup Sample Statstcs Ordnary Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals) wth OLS
More informationECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics
ECOOMICS 35*-A Md-Term Exam -- Fall Term 000 Page of 3 pages QUEE'S UIVERSITY AT KIGSTO Department of Economcs ECOOMICS 35* - Secton A Introductory Econometrcs Fall Term 000 MID-TERM EAM ASWERS MG Abbott
More informationChapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the
More informationβ0 + β1xi. You are interested in estimating the unknown parameters β
Revsed: v3 Ordnar Least Squares (OLS): Smple Lnear Regresson (SLR) Analtcs The SLR Setup Sample Statstcs Ordnar Least Squares (OLS): FOCs and SOCs Back to OLS and Sample Statstcs Predctons (and Resduals)
More informationLecture 6: Introduction to Linear Regression
Lecture 6: Introducton to Lnear Regresson An Manchakul amancha@jhsph.edu 24 Aprl 27 Lnear regresson: man dea Lnear regresson can be used to study an outcome as a lnear functon of a predctor Example: 6
More informatione i is a random error
Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where + β + β e for,..., and are observable varables e s a random error How can an estmaton rule be constructed for the unknown
More informationx i1 =1 for all i (the constant ).
Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by
More informationIII. Econometric Methodology Regression Analysis
Page Econ07 Appled Econometrcs Topc : An Overvew of Regresson Analyss (Studenmund, Chapter ) I. The Nature and Scope of Econometrcs. Lot s of defntons of econometrcs. Nobel Prze Commttee Paul Samuelson,
More informationChapter 9: Statistical Inference and the Relationship between Two Variables
Chapter 9: Statstcal Inference and the Relatonshp between Two Varables Key Words The Regresson Model The Sample Regresson Equaton The Pearson Correlaton Coeffcent Learnng Outcomes After studyng ths chapter,
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 008 Recall: man dea of lnear regresson Lnear regresson can be used to study
More informationLecture 9: Linear regression: centering, hypothesis testing, multiple covariates, and confounding
Recall: man dea of lnear regresson Lecture 9: Lnear regresson: centerng, hypothess testng, multple covarates, and confoundng Sandy Eckel seckel@jhsph.edu 6 May 8 Lnear regresson can be used to study an
More informationDO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes
25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationa. (All your answers should be in the letter!
Econ 301 Blkent Unversty Taskn Econometrcs Department of Economcs Md Term Exam I November 8, 015 Name For each hypothess testng n the exam complete the followng steps: Indcate the test statstc, ts crtcal
More informationModule Contact: Dr Susan Long, ECO Copyright of the University of East Anglia Version 1
UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PG Examnaton 016-17 ECONOMETRIC METHODS ECO-7000A Tme allowed: hours Answer ALL FOUR Questons. Queston 1 carres a weght of 5%; Queston carres 0%;
More informationChapter 3. Two-Variable Regression Model: The Problem of Estimation
Chapter 3. Two-Varable Regresson Model: The Problem of Estmaton Ordnary Least Squares Method (OLS) Recall that, PRF: Y = β 1 + β X + u Thus, snce PRF s not drectly observable, t s estmated by SRF; that
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for
More informationSystems of Equations (SUR, GMM, and 3SLS)
Lecture otes on Advanced Econometrcs Takash Yamano Fall Semester 4 Lecture 4: Sstems of Equatons (SUR, MM, and 3SLS) Seemngl Unrelated Regresson (SUR) Model Consder a set of lnear equatons: $ + ɛ $ + ɛ
More informationQuestion 1 carries a weight of 25%; question 2 carries 20%; question 3 carries 25%; and question 4 carries 30%.
UNIVERSITY OF EAST ANGLIA School of Economcs Man Seres PGT Examnaton 017-18 FINANCIAL ECONOMETRICS ECO-7009A Tme allowed: HOURS Answer ALL FOUR questons. Queston 1 carres a weght of 5%; queston carres
More informationAddressing Alternative. Multiple Regression Spring 2012
Addressng Alternatve Explanatons: Multple Regresson 7.87 Sprng 0 Dd Clnton hurt Gore example Dd Clnton hurt Gore n the 000 electon? Treatment s not lkng Bll Clnton How would you test ths? Bvarate regresson
More informationOutline. Zero Conditional mean. I. Motivation. 3. Multiple Regression Analysis: Estimation. Read Wooldridge (2013), Chapter 3.
Outlne 3. Multple Regresson Analyss: Estmaton I. Motvaton II. Mechancs and Interpretaton of OLS Read Wooldrdge (013), Chapter 3. III. Expected Values of the OLS IV. Varances of the OLS V. The Gauss Markov
More informationDummy variables in multiple variable regression model
WESS Econometrcs (Handout ) Dummy varables n multple varable regresson model. Addtve dummy varables In the prevous handout we consdered the followng regresson model: y x 2x2 k xk,, 2,, n and we nterpreted
More informationNow we relax this assumption and allow that the error variance depends on the independent variables, i.e., heteroskedasticity
ECON 48 / WH Hong Heteroskedastcty. Consequences of Heteroskedastcty for OLS Assumpton MLR. 5: Homoskedastcty var ( u x ) = σ Now we relax ths assumpton and allow that the error varance depends on the
More informationLecture 3 Stat102, Spring 2007
Lecture 3 Stat0, Sprng 007 Chapter 3. 3.: Introducton to regresson analyss Lnear regresson as a descrptve technque The least-squares equatons Chapter 3.3 Samplng dstrbuton of b 0, b. Contnued n net lecture
More informationUniversity of California at Berkeley Fall Introductory Applied Econometrics Final examination
SID: EEP 118 / IAS 118 Elsabeth Sadoulet and Daley Kutzman Unversty of Calforna at Berkeley Fall 01 Introductory Appled Econometrcs Fnal examnaton Scores add up to 10 ponts Your name: SID: 1. (15 ponts)
More informationJanuary Examinations 2015
24/5 Canddates Only January Examnatons 25 DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR STUDENT CANDIDATE NO.. Department Module Code Module Ttle Exam Duraton (n words)
More informationLecture 4 Hypothesis Testing
Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to
More information(c) Pongsa Pornchaiwiseskul, Faculty of Economics, Chulalongkorn University
Transform a bnary qualtatve varable (wth non-numercal values) to a dummy varable. For example, GENDER = f the observaton s male = f t s female (c) Pongsa Pornchawseskul, Faculty of Economcs, Chulalongkorn
More informationβ0 + β1xi and want to estimate the unknown
SLR Models Estmaton Those OLS Estmates Estmators (e ante) v. estmates (e post) The Smple Lnear Regresson (SLR) Condtons -4 An Asde: The Populaton Regresson Functon B and B are Lnear Estmators (condtonal
More informationTests of Single Linear Coefficient Restrictions: t-tests and F-tests. 1. Basic Rules. 2. Testing Single Linear Coefficient Restrictions
ECONOMICS 35* -- NOTE ECON 35* -- NOTE Tests of Sngle Lnear Coeffcent Restrctons: t-tests and -tests Basc Rules Tests of a sngle lnear coeffcent restrcton can be performed usng ether a two-taled t-test
More informationEcon Statistical Properties of the OLS estimator. Sanjaya DeSilva
Econ 39 - Statstcal Propertes of the OLS estmator Sanjaya DeSlva September, 008 1 Overvew Recall that the true regresson model s Y = β 0 + β 1 X + u (1) Applyng the OLS method to a sample of data, we estmate
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationEcon107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)
I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes
More informationSTAT 3008 Applied Regression Analysis
STAT 3008 Appled Regresson Analyss Tutoral : Smple Lnear Regresson LAI Chun He Department of Statstcs, The Chnese Unversty of Hong Kong 1 Model Assumpton To quantfy the relatonshp between two factors,
More information[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.
PPOL 59-3 Problem Set Exercses n Smple Regresson Due n class /8/7 In ths problem set, you are asked to compute varous statstcs by hand to gve you a better sense of the mechancs of the Pearson correlaton
More informationStatistics for Economics & Business
Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable
More informationScatter Plot x
Construct a scatter plot usng excel for the gven data. Determne whether there s a postve lnear correlaton, negatve lnear correlaton, or no lnear correlaton. Complete the table and fnd the correlaton coeffcent
More informationChapter 7 Generalized and Weighted Least Squares Estimation. In this method, the deviation between the observed and expected values of
Chapter 7 Generalzed and Weghted Least Squares Estmaton The usual lnear regresson model assumes that all the random error components are dentcally and ndependently dstrbuted wth constant varance. When
More informationSTATISTICS QUESTIONS. Step by Step Solutions.
STATISTICS QUESTIONS Step by Step Solutons www.mathcracker.com 9//016 Problem 1: A researcher s nterested n the effects of famly sze on delnquency for a group of offenders and examnes famles wth one to
More informationIf we apply least squares to the transformed data we obtain. which yields the generalized least squares estimator of β, i.e.,
Econ 388 R. Butler 04 revsons lecture 6 WLS I. The Matrx Verson of Heteroskedastcty To llustrate ths n general, consder an error term wth varance-covarance matrx a n-by-n, nxn, matrx denoted as, nstead
More informationBasically, if you have a dummy dependent variable you will be estimating a probability.
ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy
More informationECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE)
ECONOMETRICS - FINAL EXAM, 3rd YEAR (GECO & GADE) June 7, 016 15:30 Frst famly name: Name: DNI/ID: Moble: Second famly Name: GECO/GADE: Instructor: E-mal: Queston 1 A B C Blank Queston A B C Blank Queston
More informationAddressing Alternative Explanations: Multiple Regression
Addressng Alternatve Explanatons: Multple Regresson 7.87 Dd Clnton hurt Gore example Dd Clnton hurt Gore n the 000 electon? Treatment s not lkng Bll Clnton How would you test ths? Bvarate regresson of
More informationChapter 8 Indicator Variables
Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n
More informationIntroduction to Regression
Introducton to Regresson Dr Tom Ilvento Department of Food and Resource Economcs Overvew The last part of the course wll focus on Regresson Analyss Ths s one of the more powerful statstcal technques Provdes
More informationReminder: Nested models. Lecture 9: Interactions, Quadratic terms and Splines. Effect Modification. Model 1
Lecture 9: Interactons, Quadratc terms and Splnes An Manchakul amancha@jhsph.edu 3 Aprl 7 Remnder: Nested models Parent model contans one set of varables Extended model adds one or more new varables to
More informationLECTURE 9 CANONICAL CORRELATION ANALYSIS
LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More informationExercise 1 The General Linear Model : Answers
Eercse The General Lnear Model Answers. Gven the followng nformaton on 67 pars of values on and -.6 - - - 9 a fnd the OLS coeffcent estmate from a regresson of on. Usng b 9 So. 9 b Suppose that now also
More informationDiagnostics in Poisson Regression. Models - Residual Analysis
Dagnostcs n Posson Regresson Models - Resdual Analyss 1 Outlne Dagnostcs n Posson Regresson Models - Resdual Analyss Example 3: Recall of Stressful Events contnued 2 Resdual Analyss Resduals represent
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More informationChapter 5: Hypothesis Tests, Confidence Intervals & Gauss-Markov Result
Chapter 5: Hypothess Tests, Confdence Intervals & Gauss-Markov Result 1-1 Outlne 1. The standard error of 2. Hypothess tests concernng β 1 3. Confdence ntervals for β 1 4. Regresson when X s bnary 5. Heteroskedastcty
More informationSTAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).
(out of 15 ponts) STAT 3340 Assgnment 1 solutons (10) (10) 1. Fnd the equaton of the lne whch passes through the ponts (1,1) and (4,5). β 1 = (5 1)/(4 1) = 4/3 equaton for the lne s y y 0 = β 1 (x x 0
More information1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands
Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of
More informationLINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables
LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory
More informationJAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger
JAB Chan Long-tal clams development ASTIN - September 2005 B.Verder A. Klnger Outlne Chan Ladder : comments A frst soluton: Munch Chan Ladder JAB Chan Chan Ladder: Comments Black lne: average pad to ncurred
More informationSTAT 405 BIOSTATISTICS (Fall 2016) Handout 15 Introduction to Logistic Regression
STAT 45 BIOSTATISTICS (Fall 26) Handout 5 Introducton to Logstc Regresson Ths handout covers materal found n Secton 3.7 of your text. You may also want to revew regresson technques n Chapter. In ths handout,
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationChapter 15 - Multiple Regression
Chapter - Multple Regresson Chapter - Multple Regresson Multple Regresson Model The equaton that descrbes how the dependent varable y s related to the ndependent varables x, x,... x p and an error term
More informationProperties of Least Squares
Week 3 3.1 Smple Lnear Regresson Model 3. Propertes of Least Squares Estmators Y Y β 1 + β X + u weekly famly expendtures X weekly famly ncome For a gven level of x, the expected level of food expendtures
More informationResource Allocation and Decision Analysis (ECON 8010) Spring 2014 Foundations of Regression Analysis
Resource Allocaton and Decson Analss (ECON 800) Sprng 04 Foundatons of Regresson Analss Readng: Regresson Analss (ECON 800 Coursepak, Page 3) Defntons and Concepts: Regresson Analss statstcal technques
More informationLimited Dependent Variables
Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages
More informationStatistics for Managers Using Microsoft Excel/SPSS Chapter 13 The Simple Linear Regression Model and Correlation
Statstcs for Managers Usng Mcrosoft Excel/SPSS Chapter 13 The Smple Lnear Regresson Model and Correlaton 1999 Prentce-Hall, Inc. Chap. 13-1 Chapter Topcs Types of Regresson Models Determnng the Smple Lnear
More informationChapter 13: Multiple Regression
Chapter 13: Multple Regresson 13.1 Developng the multple-regresson Model The general model can be descrbed as: It smplfes for two ndependent varables: The sample ft parameter b 0, b 1, and b are used to
More informationChapter 11: Simple Linear Regression and Correlation
Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests
More informationLecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 212. Chapters 14, 15 & 16. Professor Ahmadi, Ph.D. Department of Management
Lecture Notes for STATISTICAL METHODS FOR BUSINESS II BMGT 1 Chapters 14, 15 & 16 Professor Ahmad, Ph.D. Department of Management Revsed August 005 Chapter 14 Formulas Smple Lnear Regresson Model: y =
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models
More informationLaboratory 3: Method of Least Squares
Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth
More informationsince [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation
Econ 388 R. Butler 204 revsons Lecture 4 Dummy Dependent Varables I. Lnear Probablty Model: the Regresson model wth a dummy varables as the dependent varable assumpton, mplcaton regular multple regresson
More informationCALCULUS CLASSROOM CAPSULES
CALCULUS CLASSROOM CAPSULES SESSION S86 Dr. Sham Alfred Rartan Valley Communty College salfred@rartanval.edu 38th AMATYC Annual Conference Jacksonvlle, Florda November 8-, 202 2 Calculus Classroom Capsules
More informationNUMERICAL DIFFERENTIATION
NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the
More informationStatistics II Final Exam 26/6/18
Statstcs II Fnal Exam 26/6/18 Academc Year 2017/18 Solutons Exam duraton: 2 h 30 mn 1. (3 ponts) A town hall s conductng a study to determne the amount of leftover food produced by the restaurants n the
More informationProfessor Chris Murray. Midterm Exam
Econ 7 Econometrcs Sprng 4 Professor Chrs Murray McElhnney D cjmurray@uh.edu Mdterm Exam Wrte your answers on one sde of the blank whte paper that I have gven you.. Do not wrte your answers on ths exam.
More informationEcon107 Applied Econometrics Topic 9: Heteroskedasticity (Studenmund, Chapter 10)
I. Defnton and Problems Econ7 Appled Econometrcs Topc 9: Heteroskedastcty (Studenmund, Chapter ) We now relax another classcal assumpton. Ths s a problem that arses often wth cross sectons of ndvduals,
More informationCorrelation and Regression. Correlation 9.1. Correlation. Chapter 9
Chapter 9 Correlaton and Regresson 9. Correlaton Correlaton A correlaton s a relatonshp between two varables. The data can be represented b the ordered pars (, ) where s the ndependent (or eplanator) varable,
More informationF8: Heteroscedasticity
F8: Heteroscedastcty Feng L Department of Statstcs, Stockholm Unversty What s so-called heteroscedastcty In a lnear regresson model, we assume the error term has a normal dstrbuton wth mean zero and varance
More informationLecture 2: Prelude to the big shrink
Lecture 2: Prelude to the bg shrnk Last tme A slght detour wth vsualzaton tools (hey, t was the frst day... why not start out wth somethng pretty to look at?) Then, we consdered a smple 120a-style regresson
More informationAppendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis
A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems
More informationLinear regression. Regression Models. Chapter 11 Student Lecture Notes Regression Analysis is the
Chapter 11 Student Lecture Notes 11-1 Lnear regresson Wenl lu Dept. Health statstcs School of publc health Tanjn medcal unversty 1 Regresson Models 1. Answer What Is the Relatonshp Between the Varables?.
More informationThis column is a continuation of our previous column
Comparson of Goodness of Ft Statstcs for Lnear Regresson, Part II The authors contnue ther dscusson of the correlaton coeffcent n developng a calbraton for quanttatve analyss. Jerome Workman Jr. and Howard
More informationBasic Business Statistics, 10/e
Chapter 13 13-1 Basc Busness Statstcs 11 th Edton Chapter 13 Smple Lnear Regresson Basc Busness Statstcs, 11e 009 Prentce-Hall, Inc. Chap 13-1 Learnng Objectves In ths chapter, you learn: How to use regresson
More informationCanonical transformations
Canoncal transformatons November 23, 2014 Recall that we have defned a symplectc transformaton to be any lnear transformaton M A B leavng the symplectc form nvarant, Ω AB M A CM B DΩ CD Coordnate transformatons,
More informationLinear Feature Engineering 11
Lnear Feature Engneerng 11 2 Least-Squares 2.1 Smple least-squares Consder the followng dataset. We have a bunch of nputs x and correspondng outputs y. The partcular values n ths dataset are x y 0.23 0.19
More informationPsychology 282 Lecture #24 Outline Regression Diagnostics: Outliers
Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.
More informationThe Ordinary Least Squares (OLS) Estimator
The Ordnary Least Squares (OLS) Estmator 1 Regresson Analyss Regresson Analyss: a statstcal technque for nvestgatng and modelng the relatonshp between varables. Applcatons: Engneerng, the physcal and chemcal
More informationA dummy variable equal to 1 if the nearby school is in regular session and 0 otherwise;
Lehrstuhl für Betrebswrtschaftslehre, Emprsche Wrtschaftsforschung Otto-von-Guercke-Unverstät Magdeburg, Postfach 410, 39016 Magdeburg Prof. Dr. Dr. Bodo Vogt Otto-von-Guercke-Unverstät Magdeburg Fakultät
More informationComparison of Regression Lines
STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence
More information4.3 Poisson Regression
of teratvely reweghted least squares regressons (the IRLS algorthm). We do wthout gvng further detals, but nstead focus on the practcal applcaton. > glm(survval~log(weght)+age, famly="bnomal", data=baby)
More informationNumber of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k
ANOVA Model and Matrx Computatons Notaton The followng notaton s used throughout ths chapter unless otherwse stated: N F CN Y Z j w W Number of cases Number of factors Number of covarates Number of levels
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed
More information