Making sense of Econometrics: Basics
|
|
- Denis Henderson
- 6 years ago
- Views:
Transcription
1 Making sense of Econometrics: Basics Lecture 2: Simple Regression Egypt Scholars Economic Society
2 Happy Eid Eid present! enter classroom at room name c28efb78
3 Outline 1 Regression Example 2 Population regression function Sample regression function 3 Least squares principle Desirable properties of estimators OLS estimator 4 Classical linear regression model Further properties of OLS estimator 5
4 Regression analysis Regression Example Econometric model inexact relationship disturbance term Econometric methodology theory (hypothesis).. mathematics.. econometrics.. data estimation.. hypothesis testing.. forecasting & policy purposes regression causation.. correlation simple regression population regression function
5 Regression sense Regression Example estimating the (population) mean value of the dependent variable on the basis of the known (fixed) values of the explanatory variable(s)
6 Regression example Regression Example suppose we have a total population of 60 families and their weekly income x and weekly consumption expenditure y the 60 families are divided into 10 income groups there is considerable variation in weekly consumption expenditure in each income group despite the variability of weekly consumption expenditure within each income bracket, on the average, weekly consumption expenditure increases as income increases
7 Example Regression Example dark circled points show the conditional mean values of y against the various x values joining these mean values gives the population regression line (PRL) conditional distribution of expenditure for various levels of income
8 Population regression line Regression Example
9 Population regression function Population regression function Sample regression function E(y x i ) = f (x i ) each conditional mean E(Y x i ) is a function of x i known as conditional expectation function (CEF) population regression function (PRF) tells how the mean (average) response of y varies with x assuming the PRF E(y x i ) is linear function of x i E(y x i ) = β 1 + β 2 x i
10 Linearity assumption Population regression function Sample regression function linearity in the variables conditional expectation of y is a linear function of x i regression curve is a straight line E(y x i ) = β 1 + β 2 xi 2 linearity in the parameters NOT linear conditional expectation of y, E(y x i ) is a linear function of the parameters; the β s may or may not be linear in the variable x E(y x i ) = β 1 + β 2 x 2 i linear
11 linear regression models Population regression function Sample regression function
12 Linear regression model Population regression function Sample regression function linear regression LRM means linear in the parameters the parameters, β s, are raised to the first power E(y x i ) = β 1 + β 2 x i LRM E(y x i ) = β 1 + β 2 xi 2 LRM non-linear regression NLRM means non-linear in the parameters E(y x i ) = β 1 + β 2 2 x i NLRM
13 Stochastic specification of PRF Population regression function Sample regression function the deviation of an individual y i around its expected value is expressed as follows u i = y i E(y x i ) y i = E(y x i ) + u i technically, u i is known as the stochastic disturbance or stochastic error term
14 Stochastic specification of PRF Population regression function Sample regression function y i = E(y x i ) + u i interpretation the expenditure of an individual family, given its income level, can be expressed as the sum of 1 E(y x i ) the mean consumption of all families with the same level of income the systematic, or deterministic, component 2 u i the random, or non systematic, component a proxy for all the omitted (neglected) variables that may affect y but are not included in the regression model
15 Stochastic specification of PRF Population regression function Sample regression function if E(y x i ) is assumed to be linear in x i y i = E(y x i ) + u i y i = β 1 + β 2 x i + u i consumption expenditure of a family is linearly related to its income plus the disturbance term
16 Stochastic specification of PRF Population regression function Sample regression function the individual consumption expenditures, given x i = $80 can be expressed as follows y i = β 1 + β 2 x i + u i y 1 = 55 = β 1 + β 2 (80) + u 1 y 2 = 60 = β 1 + β 2 (80) + u 2 y 3 = 65 = β 1 + β 2 (80) + u 3 y 4 = 70 = β 1 + β 2 (80) + u 4 y 5 = 75 = β 1 + β 2 (80) + u 5
17 Stochastic specification of PRF Population regression function Sample regression function y i = β 1 + β 2 x i + u i E(y i x i ) = E[E(y x i )] + E(u i x i ) E(y i x i ) = E(y x i ) + E(u i x i ) where expected value of a constant is that constant itself since E(y i x i ) is the same thing as E(y x i ), it implies that E(u i x i ) = 0
18 Stochastic specification of PRF Population regression function Sample regression function y i = β 1 + β 2 x i + u i E(u i x i ) = 0 thus, the assumption that the regression line passes through the conditional means of y implies that the conditional mean value of u i (conditional upon the given x s) are zero it is clear that E(y x i ) = β 1 + β 2 x i equivalent forms if E(u i x i ) = 0 y i = β 1 + β 2 x i + u i
19 Stochastic specification of PRF Population regression function Sample regression function y i = β 1 + β 2 x i + u i the stochastic specification has the advantage that it clearly shows that there are other variables besides income that affect consumption expenditure an individual family s consumption expenditure cannot be fully explained only by the variable(s) included in the regression model
20 Population regression function Sample regression function Significance of stochastic disturbance term why not include all variables in the model vagueness of theory unavailability of data core variables vs. peripheral variables intrinsic randomness in human behaviour poor proxy variables principle of parsimony wrong functional form
21 Sample regression function Population regression function Sample regression function assume we did not have data on the population we have a randomly selected sample of y values for the fixed x s can we estimate the PRF from the sample data? yes but not accurately because of sampling fluctuations
22 SRF Population regression function Sample regression function
23 Population regression function Sample regression function
24 sample regression function Population regression function Sample regression function which of the two regression lines represents the true population regression line no way we can be absolutely sure but we can try to find the best approximation of the true PRL we would get N different SRF s for N different sample, and these SRF s are not likely to be the same
25 sample regression line Population regression function Sample regression function ŷ i = ˆβ 1 + ˆβ 2 x i where ŷ i is read as "y-hat" or "y-cap" note ŷ i estimator of E(y x i ) ˆβ 1 estimator of β 1 ˆβ 2 estimator of β 2 an estimator is a formula tells how to estimate the population parameters from the information provided by the sample at hand
26 SRF Population regression function Sample regression function we can express the SRF in its stochastic form as follows y i = ŷ i + û i y i = ˆβ 1 + ˆβ 2 x i + û i û i denotes the (sample) residual term conceptually û i is analogous to u i û i introduced in the SRF for the same reasons as u i was introduced in the PRF
27 sum up Population regression function Sample regression function our primary objective in regression analysis is to estimate the PRF on the basis of the SRF y i = β 1 + β 2 x i + u i y i = ˆβ 1 + ˆβ 2 x i + û i because more often than not our analysis is based upon a single sample from some population
28 sum up Population regression function Sample regression function because of sampling fluctuations our estimate of the PRF on the base of the SRF is at best an approximate one
29 sum up in this figure Population regression function Sample regression function for x = x i we have one (sample) observation y = y i in terms of the SRF, the observed y i can be expressed as y i = ŷ i + û i and in terms of the PRF, it can be expressed as y i = E(y x i ) + u i ŷ i approximates the true E(y x i ) for the x i for any x i to the left of the point A, the SRF will underestimate the true PRF
30 Critical question Population regression function Sample regression function granted that the SRF is but an approximation of the PRF can we devise a rule that will make this approximation as close as possible? how should the SRF be constructed so that ˆβ 1 and ˆβ 2 are as close as possible to the true β 1 and β 2? note that we will never know the true β 1 and β 2
31 Population regression function Sample regression function
32 least squares Least squares principle Desirable properties of estimators OLS estimator consider the two-variable PRF y i = β 1 + β 2 x i + u i the PRF is not directly observable, we estimate it from the SRF y i = ˆβ 1 + ˆβ 2 x i + û i ŷ i is the estimated (conditional mean) value of y i y i = ŷ i + u i Now how the SRF itself determined?
33 least squares Least squares principle Desirable properties of estimators OLS estimator Now how the SRF itself determined? or û i = y i ŷ i û i = ˆβ 1 + ˆβ 2 x i ŷ i given n pairs of observations on y and x, we would like to determine the SRF in such a manner that it is as close as possible to the actual y û i = (y i ŷ i ) we may choose the SRF in such away that the sum of the residuals is as small as possible? not a very good criterion!
34 least squares Least squares principle Desirable properties of estimators OLS estimator minimizing û i is more likely to result in a small (even zero) value regardless how û i s are widely scattered around the SRL
35 least squares Least squares principle Desirable properties of estimators OLS estimator we can avoid this problem if we adopt the least-squares criterion the SRF can be fixed in such a way that û 2 i = (y i ŷ i ) 2 or ûi 2 = (y i ˆβ 1 β 2 ˆx i ) 2 is as small as possible, where û2 i are the squared residuals
36 least squares Least squares principle Desirable properties of estimators OLS estimator justifying the least-squares method minimizing û i gives the same weight in the sum (û 1 + û ) which does not reflect how far they are from the SRL by squaring û i, we give more weight to residuals such as û 1 and û 4 in the previous figure that the residuals û 2 and û 3 the estimators obtained by the least squares method have some very desirable statistical properties
37 Desirable properties Least squares principle Desirable properties of estimators OLS estimator different samples result in different estimates (sampling error) it will have a "sampling distribution" or the probability density may take any shape, but the sampling distribution of a good estimator will possess certain desirable properties
38 Desirable properties Least squares principle Desirable properties of estimators OLS estimator unbiasedness the mean of the sampling distribution for an estimator ˆβ is equal to the true population value β E( ˆβ) = β consider two possible estimators, ˆβ and β
39 Desirable properties Least squares principle Desirable properties of estimators OLS estimator unbiasedness E( ˆβ) = β unbiasedness does not ensure that estimates will always be accurate only that in repeated estimates using successive samples, the resulting estimates will be correct on average
40 Desirable properties Least squares principle Desirable properties of estimators OLS estimator efficiency more than one unbiased estimator may well exist best unbiased estimator? the estimator whose sampling distribution has the smallest variance the least widely dispersed is preferred
41 Desirable properties Least squares principle Desirable properties of estimators OLS estimator intuitively, when inaccurate estimates are obtained, they are more likely to be smaller in error (on average) the more efficient the estimator is
42 Desirable properties Least squares principle Desirable properties of estimators OLS estimator BLUE amongst the class of all unbiased linear estimators, the desired estimator is unbiased has minimum variance this is known as BLUE best linear unbiased estimator
43 unbiasedness vs efficiency Least squares principle Desirable properties of estimators OLS estimator trade off trade off between biasedness and efficiency choose an estimator that is biased (small bias) but has mush smaller variance (efficiency) than alternative unbiased estimator in this case, you can choose the estimator with the smallest mean squared errors MSE MSE(ˆθ) = bias 2 + variance MSE(ˆθ) = [E(ˆθ θ)] 2 + VAR(ˆθ)
44 OLS estimator Least squares principle Desirable properties of estimators OLS estimator the ordinary least squares OLS ensures that the estimator is BLUE under certain conditions we obtain ˆβ 2 as follows ˆβ 2 = n x i y i x i yi n xi 2 ( x i ) 2 (xi x)(yi ȳ) = (xi x) 2 = xi y i x 2 i
45 OLS estimator Least squares principle Desirable properties of estimators OLS estimator the ordinary least squares OLS ensures that the estimator is BLUE under certain conditions we obtain ˆβ 1 as follows ˆβ 1 = x 2 i yi x i xi y i n x 2 i ( x i ) 2 = ȳ ˆβ 2 x
46 Classical linear regression model Further properties of OLS estimator OLS provides the best approximation of the SRF to the PRF (BLUE) under certain conditions the summarizes those conditions recall the (stochastic) PRF: and the (stochastic) SRF: y i = β 1 + β 2 x i + u i y i = b 1 + b 2 x i + e i
47 Classical linear regression model Further properties of OLS estimator how close the SRF to the PRF (and the b s to the β s) depends on how close the residuals e i (û i ) to the true errors u i this depends on the properties of the u i the imposes certain conditions on the properties of the errors u i the Gauss-Markov theorem states that, under the assumptions, the OLS estimators are BLUE
48 assumptions Classical linear regression model Further properties of OLS estimator A1: A2: the explanatory variable x is non-stochastic x is fixed in repeated samples the average (mean) value of the error term is zero E(u i ) = 0 that is, u i is randomly positive or negative
49 assumptions Classical linear regression model Further properties of OLS estimator A3: A4: the variance of the error term is constant var(u i ) = σ 2 formally known as homoscedasticity (same variance) the error terms are independent cov(u i u j ) = 0 for i j no correlation between different error terms no autocorrelation (correlation with itself) A5: more conditions to be discussed later
50 Classical linear regression model Further properties of OLS estimator OLS attempts to make the residuals as small as possible collectively minimize e 2 i to avoid a poorly estimated relationship with very large positive and negative errors cancelling each other out property 1: the OLS regression line always passes through the sample means ȳ, x ȳ = b 1 + b 2 x
51 Classical linear regression model Further properties of OLS estimator property 2: the average value of the residuals is always zero property 3: E(e i ) = ē = 0 the explanatory variable(s) and the residuals are uncorrelated ei x i = 0 note that desirable properties for sample residuals which are approximating random population errors property 1 is arguably a minimal requirement of any estimator
52 Next Lecture you should know assignment 1 available on BB tonight due on Oct 25 (20:00 Cairo time) to be ed to eses@egyptscholars.org recorded lecture on hypothesis testing lecture 3 on Saturday Oct :00-22:00 (Cairo time) next lecture multiple regression regression examples on Stata
53
Making sense of Econometrics: Basics
Making sense of Econometrics: Basics Lecture 4: Qualitative influences and Heteroskedasticity Egypt Scholars Economic Society November 1, 2014 Assignment & feedback enter classroom at http://b.socrative.com/login/student/
More informationMaking sense of Econometrics: Basics
Making sense of Econometrics: Basics Lecture 7: Multicollinearity Egypt Scholars Economic Society November 22, 2014 Assignment & feedback Multicollinearity enter classroom at room name c28efb78 http://b.socrative.com/login/student/
More informationECON The Simple Regression Model
ECON 351 - The Simple Regression Model Maggie Jones 1 / 41 The Simple Regression Model Our starting point will be the simple regression model where we look at the relationship between two variables In
More informationSimple Linear Regression: The Model
Simple Linear Regression: The Model task: quantifying the effect of change X in X on Y, with some constant β 1 : Y = β 1 X, linear relationship between X and Y, however, relationship subject to a random
More informationEconometrics I Lecture 3: The Simple Linear Regression Model
Econometrics I Lecture 3: The Simple Linear Regression Model Mohammad Vesal Graduate School of Management and Economics Sharif University of Technology 44716 Fall 1397 1 / 32 Outline Introduction Estimating
More informationMultiple Regression Analysis. Part III. Multiple Regression Analysis
Part III Multiple Regression Analysis As of Sep 26, 2017 1 Multiple Regression Analysis Estimation Matrix form Goodness-of-Fit R-square Adjusted R-square Expected values of the OLS estimators Irrelevant
More informationThe general linear regression with k explanatory variables is just an extension of the simple regression as follows
3. Multiple Regression Analysis The general linear regression with k explanatory variables is just an extension of the simple regression as follows (1) y i = β 0 + β 1 x i1 + + β k x ik + u i. Because
More informationEconometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018
Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate
More informationIntroduction to Estimation Methods for Time Series models. Lecture 1
Introduction to Estimation Methods for Time Series models Lecture 1 Fulvio Corsi SNS Pisa Fulvio Corsi Introduction to Estimation () Methods for Time Series models Lecture 1 SNS Pisa 1 / 19 Estimation
More informationTwo-Variable Regression Model: The Problem of Estimation
Two-Variable Regression Model: The Problem of Estimation Introducing the Ordinary Least Squares Estimator Jamie Monogan University of Georgia Intermediate Political Methodology Jamie Monogan (UGA) Two-Variable
More informationIntermediate Econometrics
Intermediate Econometrics Markus Haas LMU München Summer term 2011 15. Mai 2011 The Simple Linear Regression Model Considering variables x and y in a specific population (e.g., years of education and wage
More informationRegression Models - Introduction
Regression Models - Introduction In regression models, two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent variable,
More informationLECTURE 2 LINEAR REGRESSION MODEL AND OLS
SEPTEMBER 29, 2014 LECTURE 2 LINEAR REGRESSION MODEL AND OLS Definitions A common question in econometrics is to study the effect of one group of variables X i, usually called the regressors, on another
More informationBusiness Economics BUSINESS ECONOMICS. PAPER No. : 8, FUNDAMENTALS OF ECONOMETRICS MODULE No. : 3, GAUSS MARKOV THEOREM
Subject Business Economics Paper No and Title Module No and Title Module Tag 8, Fundamentals of Econometrics 3, The gauss Markov theorem BSE_P8_M3 1 TABLE OF CONTENTS 1. INTRODUCTION 2. ASSUMPTIONS OF
More informationEconometrics Summary Algebraic and Statistical Preliminaries
Econometrics Summary Algebraic and Statistical Preliminaries Elasticity: The point elasticity of Y with respect to L is given by α = ( Y/ L)/(Y/L). The arc elasticity is given by ( Y/ L)/(Y/L), when L
More informationThe Simple Regression Model. Part II. The Simple Regression Model
Part II The Simple Regression Model As of Sep 22, 2015 Definition 1 The Simple Regression Model Definition Estimation of the model, OLS OLS Statistics Algebraic properties Goodness-of-Fit, the R-square
More information3. Linear Regression With a Single Regressor
3. Linear Regression With a Single Regressor Econometrics: (I) Application of statistical methods in empirical research Testing economic theory with real-world data (data analysis) 56 Econometrics: (II)
More informationReview of Econometrics
Review of Econometrics Zheng Tian June 5th, 2017 1 The Essence of the OLS Estimation Multiple regression model involves the models as follows Y i = β 0 + β 1 X 1i + β 2 X 2i + + β k X ki + u i, i = 1,...,
More informationSimple Linear Regression Estimation and Properties
Simple Linear Regression Estimation and Properties Outline Review of the Reading Estimate parameters using OLS Other features of OLS Numerical Properties of OLS Assumptions of OLS Goodness of Fit Checking
More informationSTAT5044: Regression and Anova. Inyoung Kim
STAT5044: Regression and Anova Inyoung Kim 2 / 47 Outline 1 Regression 2 Simple Linear regression 3 Basic concepts in regression 4 How to estimate unknown parameters 5 Properties of Least Squares Estimators:
More informationSimple Linear Regression
Simple Linear Regression ST 430/514 Recall: A regression model describes how a dependent variable (or response) Y is affected, on average, by one or more independent variables (or factors, or covariates)
More informationThe cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics
PHPM110062 Teaching Demo The cover page of the Encyclopedia of Health Economics (2014) Introduction to Econometric Application in Health Economics Instructor: Mengcen Qian School of Public Health What
More informationThe regression model with one stochastic regressor (part II)
The regression model with one stochastic regressor (part II) 3150/4150 Lecture 7 Ragnar Nymoen 6 Feb 2012 We will finish Lecture topic 4: The regression model with stochastic regressor We will first look
More informationBias Variance Trade-off
Bias Variance Trade-off The mean squared error of an estimator MSE(ˆθ) = E([ˆθ θ] 2 ) Can be re-expressed MSE(ˆθ) = Var(ˆθ) + (B(ˆθ) 2 ) MSE = VAR + BIAS 2 Proof MSE(ˆθ) = E((ˆθ θ) 2 ) = E(([ˆθ E(ˆθ)]
More informationApplied Econometrics (QEM)
Applied Econometrics (QEM) The Simple Linear Regression Model based on Prinicples of Econometrics Jakub Mućk Department of Quantitative Economics Jakub Mućk Applied Econometrics (QEM) Meeting #2 The Simple
More informationChapter 2: simple regression model
Chapter 2: simple regression model Goal: understand how to estimate and more importantly interpret the simple regression Reading: chapter 2 of the textbook Advice: this chapter is foundation of econometrics.
More informationECON2228 Notes 2. Christopher F Baum. Boston College Economics. cfb (BC Econ) ECON2228 Notes / 47
ECON2228 Notes 2 Christopher F Baum Boston College Economics 2014 2015 cfb (BC Econ) ECON2228 Notes 2 2014 2015 1 / 47 Chapter 2: The simple regression model Most of this course will be concerned with
More informationChapter 2 The Simple Linear Regression Model: Specification and Estimation
Chapter The Simple Linear Regression Model: Specification and Estimation Page 1 Chapter Contents.1 An Economic Model. An Econometric Model.3 Estimating the Regression Parameters.4 Assessing the Least Squares
More informationThe Simple Linear Regression Model
The Simple Linear Regression Model Lesson 3 Ryan Safner 1 1 Department of Economics Hood College ECON 480 - Econometrics Fall 2017 Ryan Safner (Hood College) ECON 480 - Lesson 3 Fall 2017 1 / 77 Bivariate
More informationRegression Models - Introduction
Regression Models - Introduction In regression models there are two types of variables that are studied: A dependent variable, Y, also called response variable. It is modeled as random. An independent
More informationHomoskedasticity. Var (u X) = σ 2. (23)
Homoskedasticity How big is the difference between the OLS estimator and the true parameter? To answer this question, we make an additional assumption called homoskedasticity: Var (u X) = σ 2. (23) This
More informationThe Multiple Regression Model Estimation
Lesson 5 The Multiple Regression Model Estimation Pilar González and Susan Orbe Dpt Applied Econometrics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 5 Regression model:
More informationL2: Two-variable regression model
L2: Two-variable regression model Feng Li feng.li@cufe.edu.cn School of Statistics and Mathematics Central University of Finance and Economics Revision: September 4, 2014 What we have learned last time...
More informationIntroduction to Econometrics
Introduction to Econometrics Lecture 3 : Regression: CEF and Simple OLS Zhaopeng Qu Business School,Nanjing University Oct 9th, 2017 Zhaopeng Qu (Nanjing University) Introduction to Econometrics Oct 9th,
More informationAn Introduction to Parameter Estimation
Introduction Introduction to Econometrics An Introduction to Parameter Estimation This document combines several important econometric foundations and corresponds to other documents such as the Introduction
More informationWooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model
Wooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model Most of this course will be concerned with use of a regression model: a structure in which one or more explanatory
More informationEconometrics. Week 4. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague
Econometrics Week 4 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 23 Recommended Reading For the today Serial correlation and heteroskedasticity in
More informationMS&E 226: Small Data
MS&E 226: Small Data Lecture 6: Bias and variance (v5) Ramesh Johari ramesh.johari@stanford.edu 1 / 49 Our plan today We saw in last lecture that model scoring methods seem to be trading off two different
More informationLinear Regression. Junhui Qian. October 27, 2014
Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency
More informationRegression #3: Properties of OLS Estimator
Regression #3: Properties of OLS Estimator Econ 671 Purdue University Justin L. Tobias (Purdue) Regression #3 1 / 20 Introduction In this lecture, we establish some desirable properties associated with
More informationLectures 5 & 6: Hypothesis Testing
Lectures 5 & 6: Hypothesis Testing in which you learn to apply the concept of statistical significance to OLS estimates, learn the concept of t values, how to use them in regression work and come across
More information2. Linear regression with multiple regressors
2. Linear regression with multiple regressors Aim of this section: Introduction of the multiple regression model OLS estimation in multiple regression Measures-of-fit in multiple regression Assumptions
More informationECO375 Tutorial 7 Heteroscedasticity
ECO375 Tutorial 7 Heteroscedasticity Matt Tudball University of Toronto Mississauga November 9, 2017 Matt Tudball (University of Toronto) ECO375H5 November 9, 2017 1 / 24 Review: Heteroscedasticity Consider
More informationMotivation for multiple regression
Motivation for multiple regression 1. Simple regression puts all factors other than X in u, and treats them as unobserved. Effectively the simple regression does not account for other factors. 2. The slope
More informationLab 07 Introduction to Econometrics
Lab 07 Introduction to Econometrics Learning outcomes for this lab: Introduce the different typologies of data and the econometric models that can be used Understand the rationale behind econometrics Understand
More informationEmpirical Market Microstructure Analysis (EMMA)
Empirical Market Microstructure Analysis (EMMA) Lecture 3: Statistical Building Blocks and Econometric Basics Prof. Dr. Michael Stein michael.stein@vwl.uni-freiburg.de Albert-Ludwigs-University of Freiburg
More informationstatistical sense, from the distributions of the xs. The model may now be generalized to the case of k regressors:
Wooldridge, Introductory Econometrics, d ed. Chapter 3: Multiple regression analysis: Estimation In multiple regression analysis, we extend the simple (two-variable) regression model to consider the possibility
More informationRegression Estimation - Least Squares and Maximum Likelihood. Dr. Frank Wood
Regression Estimation - Least Squares and Maximum Likelihood Dr. Frank Wood Least Squares Max(min)imization Function to minimize w.r.t. β 0, β 1 Q = n (Y i (β 0 + β 1 X i )) 2 i=1 Minimize this by maximizing
More informationECON3150/4150 Spring 2015
ECON3150/4150 Spring 2015 Lecture 3&4 - The linear regression model Siv-Elisabeth Skjelbred University of Oslo January 29, 2015 1 / 67 Chapter 4 in S&W Section 17.1 in S&W (extended OLS assumptions) 2
More informationThe regression model with one fixed regressor cont d
The regression model with one fixed regressor cont d 3150/4150 Lecture 4 Ragnar Nymoen 27 January 2012 The model with transformed variables Regression with transformed variables I References HGL Ch 2.8
More informationEconometrics. Week 8. Fall Institute of Economic Studies Faculty of Social Sciences Charles University in Prague
Econometrics Week 8 Institute of Economic Studies Faculty of Social Sciences Charles University in Prague Fall 2012 1 / 25 Recommended Reading For the today Instrumental Variables Estimation and Two Stage
More informationEconometrics - 30C00200
Econometrics - 30C00200 Lecture 11: Heteroskedasticity Antti Saastamoinen VATT Institute for Economic Research Fall 2015 30C00200 Lecture 11: Heteroskedasticity 12.10.2015 Aalto University School of Business
More informationLecture 3: Multiple Regression
Lecture 3: Multiple Regression R.G. Pierse 1 The General Linear Model Suppose that we have k explanatory variables Y i = β 1 + β X i + β 3 X 3i + + β k X ki + u i, i = 1,, n (1.1) or Y i = β j X ji + u
More informationTopic 7: HETEROSKEDASTICITY
Universidad Carlos III de Madrid César Alonso ECONOMETRICS Topic 7: HETEROSKEDASTICITY Contents 1 Introduction 1 1.1 Examples............................. 1 2 The linear regression model with heteroskedasticity
More informationRegression Analysis Tutorial 34 LECTURE / DISCUSSION. Statistical Properties of OLS
Regression Analysis Tutorial 34 LETURE / DISUSSION Statistical Properties of OLS Regression Analysis Tutorial 35 Statistical Properties of OLS y = " + $x + g dependent included omitted variable explanatory
More information6. Assessing studies based on multiple regression
6. Assessing studies based on multiple regression Questions of this section: What makes a study using multiple regression (un)reliable? When does multiple regression provide a useful estimate of the causal
More informationMS&E 226: Small Data. Lecture 6: Bias and variance (v2) Ramesh Johari
MS&E 226: Small Data Lecture 6: Bias and variance (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 47 Our plan today We saw in last lecture that model scoring methods seem to be trading o two di erent
More informationWooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares
Wooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares Many economic models involve endogeneity: that is, a theoretical relationship does not fit
More information1/34 3/ Omission of a relevant variable(s) Y i = α 1 + α 2 X 1i + α 3 X 2i + u 2i
1/34 Outline Basic Econometrics in Transportation Model Specification How does one go about finding the correct model? What are the consequences of specification errors? How does one detect specification
More informationLinear models. Linear models are computationally convenient and remain widely used in. applied econometric research
Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y
More informationLecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16)
Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) 1 2 Model Consider a system of two regressions y 1 = β 1 y 2 + u 1 (1) y 2 = β 2 y 1 + u 2 (2) This is a simultaneous equation model
More informationEnvironmental Econometrics
Environmental Econometrics Syngjoo Choi Fall 2008 Environmental Econometrics (GR03) Fall 2008 1 / 37 Syllabus I This is an introductory econometrics course which assumes no prior knowledge on econometrics;
More informationUsing regression to study economic relationships is called econometrics. econo = of or pertaining to the economy. metrics = measurement
EconS 450 Forecasting part 3 Forecasting with Regression Using regression to study economic relationships is called econometrics econo = of or pertaining to the economy metrics = measurement Econometrics
More information1. You have data on years of work experience, EXPER, its square, EXPER2, years of education, EDUC, and the log of hourly wages, LWAGE
1. You have data on years of work experience, EXPER, its square, EXPER, years of education, EDUC, and the log of hourly wages, LWAGE You estimate the following regressions: (1) LWAGE =.00 + 0.05*EDUC +
More informationOutline. Possible Reasons. Nature of Heteroscedasticity. Basic Econometrics in Transportation. Heteroscedasticity
1/25 Outline Basic Econometrics in Transportation Heteroscedasticity What is the nature of heteroscedasticity? What are its consequences? How does one detect it? What are the remedial measures? Amir Samimi
More informationECO375 Tutorial 8 Instrumental Variables
ECO375 Tutorial 8 Instrumental Variables Matt Tudball University of Toronto Mississauga November 16, 2017 Matt Tudball (University of Toronto) ECO375H5 November 16, 2017 1 / 22 Review: Endogeneity Instrumental
More informationCHAPTER 6: SPECIFICATION VARIABLES
Recall, we had the following six assumptions required for the Gauss-Markov Theorem: 1. The regression model is linear, correctly specified, and has an additive error term. 2. The error term has a zero
More informationMultiple Regression Analysis
Chapter 4 Multiple Regression Analysis The simple linear regression covered in Chapter 2 can be generalized to include more than one variable. Multiple regression analysis is an extension of the simple
More informationInference in Regression Analysis
Inference in Regression Analysis Dr. Frank Wood Frank Wood, fwood@stat.columbia.edu Linear Regression Models Lecture 4, Slide 1 Today: Normal Error Regression Model Y i = β 0 + β 1 X i + ǫ i Y i value
More informationF9 F10: Autocorrelation
F9 F10: Autocorrelation Feng Li Department of Statistics, Stockholm University Introduction In the classic regression model we assume cov(u i, u j x i, x k ) = E(u i, u j ) = 0 What if we break the assumption?
More information1 Motivation for Instrumental Variable (IV) Regression
ECON 370: IV & 2SLS 1 Instrumental Variables Estimation and Two Stage Least Squares Econometric Methods, ECON 370 Let s get back to the thiking in terms of cross sectional (or pooled cross sectional) data
More informationMultiple Regression Analysis
Multiple Regression Analysis y = 0 + 1 x 1 + x +... k x k + u 6. Heteroskedasticity What is Heteroskedasticity?! Recall the assumption of homoskedasticity implied that conditional on the explanatory variables,
More informationMicroeconometria Day # 5 L. Cembalo. Regressione con due variabili e ipotesi dell OLS
Microeconometria Day # 5 L. Cembalo Regressione con due variabili e ipotesi dell OLS Multiple regression model Classical hypothesis of a regression model: Assumption 1: Linear regression model.the regression
More informationMFin Econometrics I Session 4: t-distribution, Simple Linear Regression, OLS assumptions and properties of OLS estimators
MFin Econometrics I Session 4: t-distribution, Simple Linear Regression, OLS assumptions and properties of OLS estimators Thilo Klein University of Cambridge Judge Business School Session 4: Linear regression,
More informationApplied Statistics and Econometrics
Applied Statistics and Econometrics Lecture 6 Saul Lach September 2017 Saul Lach () Applied Statistics and Econometrics September 2017 1 / 53 Outline of Lecture 6 1 Omitted variable bias (SW 6.1) 2 Multiple
More informationHeteroskedasticity and Autocorrelation
Lesson 7 Heteroskedasticity and Autocorrelation Pilar González and Susan Orbe Dpt. Applied Economics III (Econometrics and Statistics) Pilar González and Susan Orbe OCW 2014 Lesson 7. Heteroskedasticity
More informationIris Wang.
Chapter 10: Multicollinearity Iris Wang iris.wang@kau.se Econometric problems Multicollinearity What does it mean? A high degree of correlation amongst the explanatory variables What are its consequences?
More informationSection 3: Simple Linear Regression
Section 3: Simple Linear Regression Carlos M. Carvalho The University of Texas at Austin McCombs School of Business http://faculty.mccombs.utexas.edu/carlos.carvalho/teaching/ 1 Regression: General Introduction
More informationAdvanced Quantitative Methods: ordinary least squares
Advanced Quantitative Methods: Ordinary Least Squares University College Dublin 31 January 2012 1 2 3 4 5 Terminology y is the dependent variable referred to also (by Greene) as a regressand X are the
More informationStatistical Inference with Regression Analysis
Introductory Applied Econometrics EEP/IAS 118 Spring 2015 Steven Buck Lecture #13 Statistical Inference with Regression Analysis Next we turn to calculating confidence intervals and hypothesis testing
More informationApplied Econometrics. Applied Econometrics. Applied Econometrics. Applied Econometrics. What is Autocorrelation. Applied Econometrics
Autocorrelation 1. What is 2. What causes 3. First and higher orders 4. Consequences of 5. Detecting 6. Resolving Learning Objectives 1. Understand meaning of in the CLRM 2. What causes 3. Distinguish
More informationE 31501/4150 Properties of OLS estimators (Monte Carlo Analysis)
E 31501/4150 Properties of OLS estimators (Monte Carlo Analysis) Ragnar Nymoen 10 February 2011 Repeated sampling Section 2.4.3 of the HGL book is called Repeated sampling The point is that by drawing
More informationMultivariate Regression Analysis
Matrices and vectors The model from the sample is: Y = Xβ +u with n individuals, l response variable, k regressors Y is a n 1 vector or a n l matrix with the notation Y T = (y 1,y 2,...,y n ) 1 x 11 x
More informationEMERGING MARKETS - Lecture 2: Methodology refresher
EMERGING MARKETS - Lecture 2: Methodology refresher Maria Perrotta April 4, 2013 SITE http://www.hhs.se/site/pages/default.aspx My contact: maria.perrotta@hhs.se Aim of this class There are many different
More informationChapter 8: Estimation 1
Chapter 8: Estimation 1 Jae-Kwang Kim Iowa State University Fall, 2014 Kim (ISU) Ch. 8: Estimation 1 Fall, 2014 1 / 33 Introduction 1 Introduction 2 Ratio estimation 3 Regression estimator Kim (ISU) Ch.
More informationSimple Linear Regression
Simple Linear Regression Christopher Ting Christopher Ting : christophert@smu.edu.sg : 688 0364 : LKCSB 5036 January 7, 017 Web Site: http://www.mysmu.edu/faculty/christophert/ Christopher Ting QF 30 Week
More information1. The OLS Estimator. 1.1 Population model and notation
1. The OLS Estimator OLS stands for Ordinary Least Squares. There are 6 assumptions ordinarily made, and the method of fitting a line through data is by least-squares. OLS is a common estimation methodology
More informationUnless provided with information to the contrary, assume for each question below that the Classical Linear Model assumptions hold.
Economics 345: Applied Econometrics Section A01 University of Victoria Midterm Examination #2 Version 1 SOLUTIONS Spring 2015 Instructor: Martin Farnham Unless provided with information to the contrary,
More informationLecture 4: Multivariate Regression, Part 2
Lecture 4: Multivariate Regression, Part 2 Gauss-Markov Assumptions 1) Linear in Parameters: Y X X X i 0 1 1 2 2 k k 2) Random Sampling: we have a random sample from the population that follows the above
More informationEconomics 620, Lecture 2: Regression Mechanics (Simple Regression)
1 Economics 620, Lecture 2: Regression Mechanics (Simple Regression) Observed variables: y i ; x i i = 1; :::; n Hypothesized (model): Ey i = + x i or y i = + x i + (y i Ey i ) ; renaming we get: y i =
More informationINTRODUCTORY ECONOMETRICS
INTRODUCTORY ECONOMETRICS Lesson 2b Dr Javier Fernández etpfemaj@ehu.es Dpt. of Econometrics & Statistics UPV EHU c J Fernández (EA3-UPV/EHU), February 21, 2009 Introductory Econometrics - p. 1/192 GLRM:
More informationReview of Classical Least Squares. James L. Powell Department of Economics University of California, Berkeley
Review of Classical Least Squares James L. Powell Department of Economics University of California, Berkeley The Classical Linear Model The object of least squares regression methods is to model and estimate
More informationEconomics 113. Simple Regression Assumptions. Simple Regression Derivation. Changing Units of Measurement. Nonlinear effects
Economics 113 Simple Regression Models Simple Regression Assumptions Simple Regression Derivation Changing Units of Measurement Nonlinear effects OLS and unbiased estimates Variance of the OLS estimates
More informationQuantitative Analysis of Financial Markets. Summary of Part II. Key Concepts & Formulas. Christopher Ting. November 11, 2017
Summary of Part II Key Concepts & Formulas Christopher Ting November 11, 2017 christopherting@smu.edu.sg http://www.mysmu.edu/faculty/christophert/ Christopher Ting 1 of 16 Why Regression Analysis? Understand
More informationLeast Squares Estimation-Finite-Sample Properties
Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions
More informationOSU Economics 444: Elementary Econometrics. Ch.10 Heteroskedasticity
OSU Economics 444: Elementary Econometrics Ch.0 Heteroskedasticity (Pure) heteroskedasticity is caused by the error term of a correctly speciþed equation: Var(² i )=σ 2 i, i =, 2,,n, i.e., the variance
More informationEstadística II Chapter 4: Simple linear regression
Estadística II Chapter 4: Simple linear regression Chapter 4. Simple linear regression Contents Objectives of the analysis. Model specification. Least Square Estimators (LSE): construction and properties
More informationEconomics 308: Econometrics Professor Moody
Economics 308: Econometrics Professor Moody References on reserve: Text Moody, Basic Econometrics with Stata (BES) Pindyck and Rubinfeld, Econometric Models and Economic Forecasts (PR) Wooldridge, Jeffrey
More informationECONOMETRICS Introduction & First Principles
ECONOMETRICS Introduction & First Principles DA V I D C. BR O A D S T O C K Research Institute of Economics & Management, China. OSEC Pre-Master Course, 2015. COURSE OUTLINE Part 1. Introduction to econometrics:
More informationEconometrics Multiple Regression Analysis: Heteroskedasticity
Econometrics Multiple Regression Analysis: João Valle e Azevedo Faculdade de Economia Universidade Nova de Lisboa Spring Semester João Valle e Azevedo (FEUNL) Econometrics Lisbon, April 2011 1 / 19 Properties
More information