Our point of departure, as in Chapter 2, will once more be the outcome equation:

Size: px
Start display at page:

Download "Our point of departure, as in Chapter 2, will once more be the outcome equation:"

Transcription

1 Chapter 4 Instrumental variables I 4.1 Selection on unobservables Our point of departure, as in Chapter 2, will once more be the outcome equation: Y Dβ + Xα + U, 4.1 where treatment intensity will once again be given by equation 4.2: D Xπ + Zγ + U D Selection on unobservables Contrary to the assumption in chapter 2, we will now assume that it is no longer the case that U D U, and will hence assume that: cov U D, U. 4.3 Equation 4.3 implies that D and U are correlated, and we are thus in the presence of Source of Bias No. 1, as in Chapter 3. Why does the correlation between U and U D cause problems? To see why, simply consider the expression for E β OLS that we derived in Chapter 2. You will certainly recall that equation 2.22 stated that, under the assumption of selection on observables i.e. that D Xπ + U D : E β OLS β + cov U D, U. var U D It should be transparent that as soon as cov U D, U, and as long as var U D, that we will now have E β OLS β. In section in Chapter 2, there was a first hint on how to proceed. Recall that we wrote: Y Dβ + Xα + Zφ + U, D Xπ + Zγ + U D, and then assumed that we "forgot" to include Z in our outcome equation, despite the 39

2 4 CHAPTER 4. INSTRUMENTAL VARIABLES I fact that it entered the treatment intensity equation. This yielded: γ var Z φ + cov U D, U E β OLS β +. γ var Z + EZ M X EZ γ + var U D But what if we should "forget" Z in our outcome equation? Can we make any headway if we were able to safely assume that φ, and that γ? OLS is certainly not going to be the answer because, under these assumptions: cov U D, U E β OLS β +. γ var Z + EZ M X EZ γ + var U D 4.2 Instrumental variables are consistent, but biased Assume that φ, and that γ. 1 Our pair of equations is then given by: Y Dβ + Xα + U, D Xπ + Zγ + U D. which we shall write in partialled out form as: M X Y M X Dβ + M X U, 4.4 M X D M X Zγ + M X U D. 4.5 We will also write the structural equation in another way as: Y Xπ + Zγ + U D β + Xα + U, Zγβ + X πβ + α + U + U D β, or, in partialled out form, and posing V U + U D β : M X Y M X Zγβ + M X V Notation and basic setup As most readers will know, the intuition behind two-stage least squares is to run OLS on our structural equation as we saw this would yield β OLS M XD M X Y M X D M X, which we D know to be biased and inconsistent, but to replace D with its predicted value D from the first-stage reduced form. Note that the predicted value of M X D from the estimated partialled out reduced form can be written as: M X D MX Z γ M X Z M X Z M X Z 1 MX Z M X D, 4.7 γ M X Z M X Z M X Z 1 MX Z M X D P MX ZM X D, 4.8 P MX Z 1 This section is based on Hahn and Hausman 22b.

3 4.2. INSTRUMENTAL VARIABLES ARE CONSISTENT, BUT BIASED 41 where: P MX Z M X Z M X Z M X Z 1 MX Z, is the usual projection matrix of the instruments. expression for the 2SLS estimate of β as: We can then write the standard β 2SLS M XZ γ M X Y M X Z γ M X Z γ D M X P MX ZM X Y D M X P MX ZM X D D P MX ZY D P MX ZD. 4.9 The basic problem here is that we don t have Zγ, but an estimate, given by Z γ. More specifically: γ M XZ M X D M X Z M X Z. Begin with 4.9 and subtract the true value of β yields: Replacing using 4.6: β 2SLS β M XZ γ M X Y M X Z γ β M X Z γ. M X Z γ M X Y from 4.6 β 2SLS β M {}}{ XZ γ M X Zγβ + M X V M X Z γ β M X Z γ, 4.1 M X Z γ M XZ γ M X V M X Z γ γ β M X Z γ. M X Z γ This is the key expression that we will work on in what follows Writing things in terms of ther 2 of the reduced form Recall that the partial R 2 of the partialled out first stage reduced form is defined as the proportion of the variance of M X D that is explained by M X Z: R 2 f M XZ γ M X Z γ M X D M X D, so that: and therefore M X Z γ M X Z γ R 2 f M X D M X D, β 2SLS β M XZ γ M X V M X Z γ γ β M X Z γ M X Z γ M XZ γ M X V M X Z γ γ β Rf 2 M XD. M X D 4.11 The interpretation of this expression is clear: ceteris paribus, the bias of 2SLS increases as Rf 2 becomes small. This is a first indication of why it is so important that your instruments be "strong".

4 42 CHAPTER 4. INSTRUMENTAL VARIABLES I The numerator of 2SLS bias We now return to dealing with 4.1. Equating 4.4 and 4.6 yields: which can be rearranged as: which in turn implies that: M X Y from 4.4 M X Y from 4.6 {}}{ M X Dβ + M X U M X Zγβ + M X V, M X V M X Dβ M X Zγβ + M X U, M X V M X Z γ γ β M X Dβ M X Zγβ + M X U M X Z γ γ β 4.12 M X V M X Dβ + M X U M X Z γβ. Now consider the numerator of 4.1 and substitute using 4.7 and 4.12: M X Z γ M X V M X Z γ γ β P MX ZM X D M X Dβ + M X U M X Z γβ, M X Z γ from 4.7 M X V M X Z γ γβ from 4.12 Now substitute again using 4.7: P MX ZM X D M X Dβ + M X U M X Z γβ. M X Z γ M X V M X Z γ γ β P MX ZM X D M X Dβ + M X U P MX ZM X D β, M X Z γ from 4.7 which can be rewritten as: P MX ZM X D I P MX Z M X Dβ + M X U, M X Z γ M X V M X Z γ γ β P MX ZM X D M MX Z M X Dβ + M X U. I P MX Z Carrying out the multiplication yields: M X Z γ M X V M X Z γ γ β P MX ZM X D M MX ZM X Dβ + M X U, D M X P MX ZM MX ZM X Dβ + P MX ZM X D M X U. where P MX ZM MX Z because P MX Z and M MX Z are orthogonal complements. 2 equality therefore simplifies to: The M X Z γ M X V M X Z γ γ β P MX ZM X D M X U. 2 P MX ZM MX Z P MX Z I P MX Z P MX Z P MX ZP MX Z P MX Z P MX Z n.

5 4.2. INSTRUMENTAL VARIABLES ARE CONSISTENT, BUT BIASED 43 Now develop the remaining term on the RHS using the "true" expression for M X D from equation 4.5: M X Z γ M X V M X Z γ γ β P MX ZM X D M X U, and thus: P MX ZM X Zγ + M X U D M X U, M X D from 4.5 P MX ZM X Zγ M X U + P MX ZM X U D M X U, M X Z γ M X V M X Z γ γ β P MX ZM X Zγ M X U + P MX ZM X U D M X U. Now replace the projection matrix explicitly on the RHS of this expression: M X Z γ M X V M X Z γ γ β M X Z M X Z M X Z 1 MX Z M X Z γ M X U P MX Z Simplifying terms then yields: so that: + P MX ZM X U D M X U. M X Z γ M X V M X Z γ γ β M X Zγ M X U + P MX ZM X U D M X U, Note also that: γ Z M X U + M X U D P MX Z M X U, M X Z γ M X V M X Z γ γ β γ Z M X U + U D M XP MX ZM X U. which implies that: Finally, take expectations: M X P MX ZM X M X M X Z M X Z M X Z 1 MX Z M X, M X Z M X Z M X Z 1 MX Z, P MX Z, M X Z γ M X V M X Z γ γ β γ Z M X U + U D P M X ZU. E M X Z γ M X V M X Z γ γ β γ E Z M X U + E U DP MX ZU The denominator of 2SLS bias Now consider the denominator of 4.1: M X Z γ M X Z γ P MX ZM X D P MX ZM X D M X D P MX Z M X D.

6 44 CHAPTER 4. INSTRUMENTAL VARIABLES I Substitute from the "true" reduced form and expand the expression; this yields: M X Z γ M X Z γ M X D P MX Z M X D, M X Zγ + M X U D P MX Z M X Zγ + M X U D. Now develop the product on the RHS: M X Z γ M X Z γ γ M X Z P MX Z M X Z γ + γ M X Z P MX Z M X U D + M X U D P MX ZM X Zγ + M X U D P MX ZM X U D, which can be written more esthetically as: M X Z γ M X Z γ γ M X Z M X Z γ + γ M X Z M X U D + M X U D M X Z γ + M X U D P MX Z M X U D, or M X Z γ M X Z γ γ Z M X Zγ + γ Z M X U D + U DM X Zγ + U D M X P MX ZM X U D. Since we have already shown that M X P MX ZM X P MX Z, this simplifies to: M X Z γ M X Z γ γ Z M X Zγ + γ Z M X U D + U DM X Zγ + U DP MX ZU D. Finally, take expectations: E M X Z γ M X Z γ γ E Z M X Z γ + γ E Z M X U D E U DM X Z γ + E U DP MX ZU D Combining the two expressions Pulling everything together, and substituting 4.13 and 4.14 into 4.1 allows one to rewrite the expression for the bias of 2SLS as: E β 2SLS β E M X Z γ M X V M X Z γ γ β E M X Z γ M X Z γ γ E Z M X U + E U DP MX ZU γ E Z M X Z γ + γ E Z M X U D + E U D M XZ γ + E U D P M X ZU D. Applying Theorem 2 to the various bilinear forms in this last expression, we obtain: E Z M X U tr M X cov Z, U + E Z M X E U, E U D P M X ZU tr P MX Z cov U D, U + E U D P MX ZE U, tr P MX Z cov U D, U,

7 4.2. INSTRUMENTAL VARIABLES ARE CONSISTENT, BUT BIASED 45 E U DP MX ZU D tr P MX Z cov U D, U D + E U D P MX ZE U D, tr P MX Z var U D, E Z M X U D tr M X cov Z, U D + E Z M X E U D, E Z M X Z tr M X var Z + EZ M X E Z. Note also that there is an alternative expression for the denominator, given by E R 2 f M XD M X D R 2 f E D M X D R 2 f tr M X var D + E D M X E D. Substituting into the expression for E β 2SLS β yields: E β 2SLS β {}}{ γ E Z M X U + E U D P M X ZU γ E Z M X Z γ + γ E Z M X U D + E U DM X Z γ + E U D P M X ZU D, so that: E β 2SLS β tr P MX Z cov U D, U γ tr M X var Z + E Z M X E Z γ + tr P MX Z var U D. In order to tidy up this expression, we need to establish the trace of P MX Z. tr P MX Z tr M X Z M X Z M X Z 1 MX Z, tr M X Z M X Z M X Z M X Z 1, tr Z M X Z Z M X Z 1, tr I KZ, K Z, Note that: where the second equality follows from the commutative property of the trace operator. Recall also from Lemma 1 that rank M X n K X. Therefore: tr M X var Z + E Z M X E Z n K X var Z + E Z M X E Z. Therefore, we can rewrite E β 2SLS β as: E β 2SLS β tr P MX Z cov U D, U γ tr M X var Z + E Z M X E Z γ + tr P MX Z var U D, K Z cov U D, U, n K X γ var Z + EZ M X EZ γ + K Z var U D

8 46 CHAPTER 4. INSTRUMENTAL VARIABLES I or alternatively, in terms of the r-squared of the reduced form: E β 2SLS β K Z cov U D, U R 2 f n K X var D + E D M X E D. These are two very useful expression for understanding 2SLS. following: They tell you the bias is increasing in the number of instruments, K Z ; bias is increasing in the "degree of endogeneity," cov U D, U; bias is decreasing in the fit of the first-stage reduced form, R 2 f ; bias is increasing in the number of exogenous covariates, K X ; bias is decreasing in the variance of treatment intensity, var D ; as instruments become weak, lime β 2SLS β covu D,U γ varu D instruments bias 2SLS towards OLS; as n gets large n the bias decreases: 2SLS is consistent. E β OLS β : weak

9 4.3. THE FORBIDDEN REGRESSION The forbidden regression One of the most common mistakes made in applying 2SLS in practice has been memorably christened the "forbidden regression" by Jerry Hausman. Though the version of the forbidden regression discussed in standard textbooks such as Wooldridge stems, for example, from confusing the linear prediction of a quadratic term with the square of the linear prediction, the Hausman version of the "forbidden regression" is arguably much more common. 3 There are probably two reasons for this. First, because higher order or multiplicative terms are common though not legion in applied work, but second, and most importantly, because running the Hausman forbidden regression is so easy to do. This is particularly true because of the bad habit of carrying out two-stage procedures in which the first-stage reduced form is used to produce an estimated value of treatment intensity, D, which is then plugged into an OLS estimate of β in the structural equation. The problem is that generations of applied researchers have plugged the wrong value of D into the structural equation. In algebraic terms, the predicted value of D used in the forbidden regression is obtained by incorrectly replacing γ M XZ M X D with γ M X Z M X Z F R Z D and only then partialing Z Z out X from the structural equation. In all fairness to the aforementioned researchers, it is often the case that a subset of the Xs is unintentionally omitted from the first-stage reduced form. In what follows, I consider the case where all Xs have been forgotten: the attentive reader will notice that the argument applies to the general case as long as the other non-offensive covariates have already been partialled out both from the structural equation and from the reduced form. In words, the correct 2SLS procedure entails including all of the exogenous covariates that appear in the structural equation in the first-stage reduced form. The forbidden regression involves leaving some or all of them out. In what follows, I derive the expression for the bias of the 2SLS estimator in the case of the forbidden regression, and consider the conditions under which the bias in question will be equal to that of the correct 2SLS procedure. I also show, as is well-known, that 2SLS is inconsistent when the forbidden regression is run, except under very particular circumstances. The incorrect predicted value of D that is used in the forbidden regression can be written as: 1 Z M X Z γ F R M X ZZ Z 1 Z D, M X Z Z Z D M X P Z D γ F R P Z Consider the expression for bias given earlier in equation 4.11, where we have now replaced γ with γ F R : β F R β M XZ γ F R M X V M X Z γ F R γ β M X Z γ F R. M X Z γ F R Substituting M X P Z D for M X Z γ F R into the numerator of the expression for β F R β 3 In the Wooldridge version, one confuses, for example, P Z D 2 with P Z D 2 for the quadratic example, or P Z WD with WP Z D for a multiplicative example.

10 48 CHAPTER 4. INSTRUMENTAL VARIABLES I yields: and thus: M X Z γ F R M X V M X Z γ F R γ β M X Z γ F R M X Dβ + M X U M X Z γ F R β, M X P Z D M X Dβ + M X U M X P Z Dβ, M X P Z D M X I P Z Dβ + M X U, D P Z M X M X M Z Dβ + M X U, M X Z γ F R M X V M X Z γ F R γ β D P Z M X M Z Dβ + D P Z M X U Partialling out Z from the treatment intensity equation yields: M Z D M Z Xπ + M Z U D, whereas pre-multiplying treatment intensity by P Z and transposing yields: D P Z π X P Z + γ Z + U DP Z. Substituting these two expressions into 4.16: M X Z γ F R M X V M X Z γ F R γ β D P Z M X M Z Dβ + D P Z M X U D P {}} Z M { Z D {}}{ π X P Z + γ Z + U DP Z M X M Z Xπ + M Z U D β D P Z {}}{ + π X P Z + γ Z + U D P ZM X U. Developing terms on the RHS, one obtains: M X Z γ F R M X V M X Z γ F R γ β π X P Z M X M Z Xπ + γ Z M X M Z Xπ + U D P ZM X M Z Xπ +π X P Z M X M Z U D + γ Z M X M Z U D + U D P β ZM X M Z U D + π X P Z M X U + γ Z M X U + U DP Z M X U. Taking expectations yields: E M X Z γ F R M X V M X Z γ F R γ β π E X P Z M X M Z X π + γ E Z M X M Z X π +E U D P ZM X M Z X π + π E X P Z M X M Z U D β γ E Z M X M Z U D + E U DP Z M X M Z U D +π E X P Z M X U + γ E Z M X U + E U DP Z M X U.

11 4.3. THE FORBIDDEN REGRESSION 49 Applying Theorem 2 allows one to write: E X P Z M X M Z X tr P Z M X M Z var X + E X P Z M X M Z E X tr M Z P Z M X var X + E X P Z M X M Z E X E X P Z M X M Z E X, where the second equality follows from the commutative property of the trace, E Z M X M Z X tr M X M Z cov Z, X + E Z M X M Z E X, E U DP Z M X M Z X, E X P Z M X M Z U D, E Z M X M Z U D, E U DP Z M X M Z U D tr P Z M X M Z var U D, E X P Z M X U, E Z M X U, E U DP Z M X U tr P Z M X cov U D, U. Substituting the preceding expectations into the expression for the numerator given in 4.17 then yields: E M X Z γ F R M X V M X Z γ F R γ β π E X P Z M X M Z E X +γ tr M X M Z cov Z, X + E Z M X M Z E X +tr P Z M X cov U D, U. πβ 4.18 Now consider the denominator of the expression for β F R β. substitutions as for the denominator yields: Making the same M X Z γ F R M X Z γ F R M X P Z D M X P Z D D P Z M X P Z D and performing the multiplication gives us: D P {}} Z P { Z D π X P Z + γ Z + U D P {}}{ ZM X P Z Xπ + Zγ + P Z U D, M X Z γ F R M X Z γ F R π X P Z M X P Z Xπ + π X P Z M X Zγ + π X P Z M X P Z U D +γ Z M X P Z Xπ + γ Z M X Zγ + γ Z M X P Z U D +U DP Z M X P Z Xπ + U DP Z M X Zγ + U DP Z M X P Z U D,

12 5 CHAPTER 4. INSTRUMENTAL VARIABLES I whereas taking expectations yields: E M X Z γ F R M X Z γ F R π E X P Z M X P Z X π + π E X P Z M X Z γ which can be simplified to: {}}{ +π E X P Z M X P Z U D + γ E Z M X P Z X π {}}{ +γ E Z M X Z γ + γ E Z M X P Z U D {}}{ + E U DP Z M X P Z Xπ + E U DP Z M X Zγ +E U DP Z M X P Z U D, E M X Z γ F R M X Z γ F R π E X P Z M X P Z X π + π E X P Z M X Z γ γ E Z M X P Z X π + γ E Z M X Z γ +E U DP Z M X P Z U D. Noticing, again by the commutative property of the trace, that then allows one to rewrite 4.19 as: tr P Z M X P Z tr P Z P Z M X tr P Z M X, E M X Z γ F R M X Z γ F R π tr P Z M X var X + E X P Z M X P Z E X π +π tr P Z M X cov Z, X + E X P Z M X E Z γ +γ tr P Z M X cov Z, X + E Z M X P Z E X π +γ n K X var Z + E Z M X E Z γ +tr P Z M X var U D, or E M X Z γ F R M X Z γ F R π var X + EX P Z M X P Z EX π +π cov Z, X + EX P Z M X EZ γ tr P Z M X +γ cov Z, X + EZ M X P Z EX π n K + X γ var Z + EZ M X EZ γ +var U D

13 4.3. THE FORBIDDEN REGRESSION Bias in the forbidden regression We now pull everything together into the expression for E β F R β, which is trivially seen to be given by: Noticing that: E β F R β π E X P Z M X M Z E X +γ tr M X M Z cov Z, X + E Z πβ M X M Z E X +tr P Z M X cov U D, U π var X + EX P Z M X P Z EX π +π cov Z, X + EX P Z M X EZ γ tr P Z M X +γ cov Z, X + EZ M X P Z EX π n K + X γ var Z + EZ M X EZ γ +var U D. 4.2 tr M X M Z tr M Z M X tr M X P Z M X n K X tr P Z M X, allows one to rewrite this as: E β F R β π E X P Z M X M Z E X +γ n K X tr P Z M X cov Z, X + E Z M X M Z E X +tr P Z M X cov U D, U π var X + EX P Z M X P Z EX π +π cov Z, X + EX P Z M X EZ γ tr P Z M X +γ cov Z, X + EZ M X P Z EX π n K + X γ var Z + EZ M X EZ γ +var U D πβ 4.21 In order to clarify issues, consider a special: π : in this case, in which the omission of X from the first stage reduced form is "justified", 4.21 simplifies to: E β F R β tr P Z M X cov U D, U n K X γ var Z + EZ M X EZ γ + tr P Z M X var U D This is the exactly the same expression as for E β 2SLS β, except that K Z is replaced with tr P Z M X. Since, by Theorem 1.24 in Takeuchi, Yanai, and Mukherjee 1982: tr P Z M X min tr P Z, tr M X min K Z, n K X K Z,

14 52 CHAPTER 4. INSTRUMENTAL VARIABLES I it follows that: E β F R β E β 2SLS β. Unsurprisingly, if the covariates X should indeed be excluded from the first-stage reduced form, bias is smaller if one does so. In all other cases the expression for E β F R β differs from that for E β 2SLS β Inconsistency in the forbidden regression Finally, note that, contrary to the correct 2SLS expression, running the forbidden regression yields an inconsistent estimate of β. To see why, rewrite 4.21 as: E β F R β 1 +γ 1 1 π E X P Z M X M Z E X tr P Z M X + 1 tr P Z M X cov U D, U 1 π tr P Z M X cov Z, X + 1 E Z M X M Z E X var X + EX P Z M X P Z EX π + 1 π cov Z, X + EX P Z M X EZ γ + 1 γ cov Z, X + EZ M X P Z EX π 1 + γ var Z + EZ M X EZ γ + 1 var U D πβ where we have simply divided by n K X in both the numerator and the denominator. It follows, taking the limit, that: lim E β F R β n γ cov Z, X π β 4.23 γ var Z + EZ M X EZ γ As such, running the forbidden regression will yield an inconsistent parameter estimate unless one of the three following conditions holds: cov Z, X ; π ; β.

15 4.4. BIAS CORRECTION AND K CLASS Bias correction and k class Taking the numerator for 2SLS bias that we have just derived and combining it with the initial expression for the denominator from earlier allows us to write: E β 2SLS β K Zcov U D, U D P MX ZD. Though we do not have an estimate of U since it depends upon the parameter, β, that we are seeking to estimate, we do have an estimate of U D, given by: Û D D X π Z γ. From the partitioned inverse formula that we saw in chapter 2, we know that: X π γ X 1 X I Z Z M X Z 1 Z M X D Z M X Z 1 Z. M X D It follows that: Û D D X π Z γ, D X X X 1 X I Z Z M X Z 1 Z M X D Z Z M X Z 1 Z M X D, I X X X 1 X D I X X X 1 X Z Z M X Z 1 Z M X D, M X D M X Z Z M X Z 1 Z M X D, M X D P MX ZD, M X M MX ZD. Now note that: covû D U 1 n K X K Z EÛ D U Substituting into the expression for bias yields: E β 2SLS β E Û D 1 {}}{ E D M MX ZM X Y Xα Dβ n K X K Z 1 ED M MX ZM X Y Dβ n K X K Z K Z K Z D M MX ZM X Y Dβ D P MX ZD Now define the bias-corrected estimator β N such that: β N β 2SLS E β 2SLS β D P MX ZY D P MX ZD U KZ K Z D M MX ZM X Y Dβ N D P MX ZD..

16 54 CHAPTER 4. INSTRUMENTAL VARIABLES I Solving for β N then yields: K Z β N D P MX ZY K Z D M MX ZM X Y D K P MX ZD Z K Z D M MX ZM X D. This is the estimator first proposed by Nagar Donald and Newey 21 have another version of this estimator which is almost identical, but where the correction factor is K Z 2 1 K Z 2 instead of K Z K Z drop the "2" and they become the same: β DN D P MX ZY D P MX ZD K Z 2 1 K Z 2 D M MX ZM X Y K Z 2 1 K Z 2 D M MX ZM X D. Many of the estimators that one uses in practice including OLS, 2SLS and Nagar, that we have already seen can be expressed as special cases of what are known as k-class estimators this goes a long way back to work in the 195s by Henri Theil. The general form taken by these estimators is: β κ D P MX ZY κd M MX ZM X Y D P MX ZD κd M MX ZM X D, 4.24 where κ is a scalar. You should then have no trouble in seeing that: OLS: κ 1 : β κ D P MX ZY + D M MX ZM X Y D P MX ZD + D M MX ZM X D D M X Y D M X D β OLS. 2SLS: κ : β κ D P MX ZY D P MX ZD β 2SLS. Nagar: κ K Z K Z It is harder to see, but nevertheless true that: LIML which stands for "Limited Information Maximum Likelihood": κ smallest eigenvalue, κ, of the matrix W P MX ZW W M MX ZM X W 1, where W Y, D : β κ D P MX ZY κd M MX ZM X Y D P MX ZD κd M MX ZM X D β LIML, Fuller 1977: κ smallest eigenvalue, κ, of the matrix W P MX ZW W M MX ZM X W 1,

17 4.4. BIAS CORRECTION AND K CLASS 55 where W Y, D, and for a parameter a > : D P MX ZY κ β κ D P MX ZD κ a K Z D M MX ZM X Y a K Z D M MX ZM X D β F uller.

Properties of the least squares estimates

Properties of the least squares estimates Properties of the least squares estimates 2019-01-18 Warmup Let a and b be scalar constants, and X be a scalar random variable. Fill in the blanks E ax + b) = Var ax + b) = Goal Recall that the least squares

More information

Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16)

Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) Lecture: Simultaneous Equation Model (Wooldridge s Book Chapter 16) 1 2 Model Consider a system of two regressions y 1 = β 1 y 2 + u 1 (1) y 2 = β 2 y 1 + u 2 (2) This is a simultaneous equation model

More information

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018

Econometrics I KS. Module 2: Multivariate Linear Regression. Alexander Ahammer. This version: April 16, 2018 Econometrics I KS Module 2: Multivariate Linear Regression Alexander Ahammer Department of Economics Johannes Kepler University of Linz This version: April 16, 2018 Alexander Ahammer (JKU) Module 2: Multivariate

More information

Final Exam. Economics 835: Econometrics. Fall 2010

Final Exam. Economics 835: Econometrics. Fall 2010 Final Exam Economics 835: Econometrics Fall 2010 Please answer the question I ask - no more and no less - and remember that the correct answer is often short and simple. 1 Some short questions a) For each

More information

We begin by thinking about population relationships.

We begin by thinking about population relationships. Conditional Expectation Function (CEF) We begin by thinking about population relationships. CEF Decomposition Theorem: Given some outcome Y i and some covariates X i there is always a decomposition where

More information

MS&E 226: Small Data

MS&E 226: Small Data MS&E 226: Small Data Lecture 6: Bias and variance (v5) Ramesh Johari ramesh.johari@stanford.edu 1 / 49 Our plan today We saw in last lecture that model scoring methods seem to be trading off two different

More information

Instrumental Variables

Instrumental Variables Università di Pavia 2010 Instrumental Variables Eduardo Rossi Exogeneity Exogeneity Assumption: the explanatory variables which form the columns of X are exogenous. It implies that any randomness in the

More information

1 Motivation for Instrumental Variable (IV) Regression

1 Motivation for Instrumental Variable (IV) Regression ECON 370: IV & 2SLS 1 Instrumental Variables Estimation and Two Stage Least Squares Econometric Methods, ECON 370 Let s get back to the thiking in terms of cross sectional (or pooled cross sectional) data

More information

Linear IV and Simultaneous Equations

Linear IV and Simultaneous Equations Linear IV and Daniel Schmierer Econ 312 April 6, 2007 Setup Linear regression model Y = X β + ε (1) Endogeneity of X means that X and ε are correlated, ie. E(X ε) 0. Suppose we observe another variable

More information

Measurement Error. Often a data set will contain imperfect measures of the data we would ideally like.

Measurement Error. Often a data set will contain imperfect measures of the data we would ideally like. Measurement Error Often a data set will contain imperfect measures of the data we would ideally like. Aggregate Data: (GDP, Consumption, Investment are only best guesses of theoretical counterparts and

More information

FNCE 926 Empirical Methods in CF

FNCE 926 Empirical Methods in CF FNCE 926 Empirical Methods in CF Lecture 5 Instrumental Variables Professor Todd Gormley Announcements n Exercise #2 due; should have uploaded it to Canvas already 2 Background readings n Roberts and Whited

More information

The Linear Regression Model

The Linear Regression Model The Linear Regression Model Carlo Favero Favero () The Linear Regression Model 1 / 67 OLS To illustrate how estimation can be performed to derive conditional expectations, consider the following general

More information

Problem Set #6: OLS. Economics 835: Econometrics. Fall 2012

Problem Set #6: OLS. Economics 835: Econometrics. Fall 2012 Problem Set #6: OLS Economics 835: Econometrics Fall 202 A preliminary result Suppose we have a random sample of size n on the scalar random variables (x, y) with finite means, variances, and covariance.

More information

ECO Class 6 Nonparametric Econometrics

ECO Class 6 Nonparametric Econometrics ECO 523 - Class 6 Nonparametric Econometrics Carolina Caetano Contents 1 Nonparametric instrumental variable regression 1 2 Nonparametric Estimation of Average Treatment Effects 3 2.1 Asymptotic results................................

More information

ECON The Simple Regression Model

ECON The Simple Regression Model ECON 351 - The Simple Regression Model Maggie Jones 1 / 41 The Simple Regression Model Our starting point will be the simple regression model where we look at the relationship between two variables In

More information

Least Squares Estimation-Finite-Sample Properties

Least Squares Estimation-Finite-Sample Properties Least Squares Estimation-Finite-Sample Properties Ping Yu School of Economics and Finance The University of Hong Kong Ping Yu (HKU) Finite-Sample 1 / 29 Terminology and Assumptions 1 Terminology and Assumptions

More information

Handout 11: Measurement Error

Handout 11: Measurement Error Handout 11: Measurement Error In which you learn to recognise the consequences for OLS estimation whenever some of the variables you use are not measured as accurately as you might expect. A (potential)

More information

Instrumental Variables and the Problem of Endogeneity

Instrumental Variables and the Problem of Endogeneity Instrumental Variables and the Problem of Endogeneity September 15, 2015 1 / 38 Exogeneity: Important Assumption of OLS In a standard OLS framework, y = xβ + ɛ (1) and for unbiasedness we need E[x ɛ] =

More information

1. You have data on years of work experience, EXPER, its square, EXPER2, years of education, EDUC, and the log of hourly wages, LWAGE

1. You have data on years of work experience, EXPER, its square, EXPER2, years of education, EDUC, and the log of hourly wages, LWAGE 1. You have data on years of work experience, EXPER, its square, EXPER, years of education, EDUC, and the log of hourly wages, LWAGE You estimate the following regressions: (1) LWAGE =.00 + 0.05*EDUC +

More information

EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix)

EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) 1 EC212: Introduction to Econometrics Review Materials (Wooldridge, Appendix) Taisuke Otsu London School of Economics Summer 2018 A.1. Summation operator (Wooldridge, App. A.1) 2 3 Summation operator For

More information

Linear models. Linear models are computationally convenient and remain widely used in. applied econometric research

Linear models. Linear models are computationally convenient and remain widely used in. applied econometric research Linear models Linear models are computationally convenient and remain widely used in applied econometric research Our main focus in these lectures will be on single equation linear models of the form y

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap Deviations from the standard

More information

Final Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2

Final Review Sheet. B = (1, 1 + 3x, 1 + x 2 ) then 2 + 3x + 6x 2 Final Review Sheet The final will cover Sections Chapters 1,2,3 and 4, as well as sections 5.1-5.4, 6.1-6.2 and 7.1-7.3 from chapters 5,6 and 7. This is essentially all material covered this term. Watch

More information

5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1)

5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1) 5. Erroneous Selection of Exogenous Variables (Violation of Assumption #A1) Assumption #A1: Our regression model does not lack of any further relevant exogenous variables beyond x 1i, x 2i,..., x Ki and

More information

Chapter 2: simple regression model

Chapter 2: simple regression model Chapter 2: simple regression model Goal: understand how to estimate and more importantly interpret the simple regression Reading: chapter 2 of the textbook Advice: this chapter is foundation of econometrics.

More information

The Statistical Property of Ordinary Least Squares

The Statistical Property of Ordinary Least Squares The Statistical Property of Ordinary Least Squares The linear equation, on which we apply the OLS is y t = X t β + u t Then, as we have derived, the OLS estimator is ˆβ = [ X T X] 1 X T y Then, substituting

More information

Vector, Matrix, and Tensor Derivatives

Vector, Matrix, and Tensor Derivatives Vector, Matrix, and Tensor Derivatives Erik Learned-Miller The purpose of this document is to help you learn to take derivatives of vectors, matrices, and higher order tensors (arrays with three dimensions

More information

MS&E 226: Small Data. Lecture 6: Bias and variance (v2) Ramesh Johari

MS&E 226: Small Data. Lecture 6: Bias and variance (v2) Ramesh Johari MS&E 226: Small Data Lecture 6: Bias and variance (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 47 Our plan today We saw in last lecture that model scoring methods seem to be trading o two di erent

More information

Using Instrumental Variables to Find Causal Effects in Public Health

Using Instrumental Variables to Find Causal Effects in Public Health 1 Using Instrumental Variables to Find Causal Effects in Public Health Antonio Trujillo, PhD John Hopkins Bloomberg School of Public Health Department of International Health Health Systems Program October

More information

Ability Bias, Errors in Variables and Sibling Methods. James J. Heckman University of Chicago Econ 312 This draft, May 26, 2006

Ability Bias, Errors in Variables and Sibling Methods. James J. Heckman University of Chicago Econ 312 This draft, May 26, 2006 Ability Bias, Errors in Variables and Sibling Methods James J. Heckman University of Chicago Econ 312 This draft, May 26, 2006 1 1 Ability Bias Consider the model: log = 0 + 1 + where =income, = schooling,

More information

ECO375 Tutorial 8 Instrumental Variables

ECO375 Tutorial 8 Instrumental Variables ECO375 Tutorial 8 Instrumental Variables Matt Tudball University of Toronto Mississauga November 16, 2017 Matt Tudball (University of Toronto) ECO375H5 November 16, 2017 1 / 22 Review: Endogeneity Instrumental

More information

plim W 0 " 1 N = 0 Prof. N. M. Kiefer, Econ 620, Cornell University, Lecture 16.

plim W 0  1 N = 0 Prof. N. M. Kiefer, Econ 620, Cornell University, Lecture 16. 1 Lecture 16: Estimation of Simultaneous Equations Models Consider y 1 = Y 2 + X 1 + " 1 which is an equation from a system. We can rewrite this at y 1 = Z +" 1 where Z = [Y 2 X 1 ] and = [ 0 0 ] 0. Note

More information

Instrumental Variables. Ethan Kaplan

Instrumental Variables. Ethan Kaplan Instrumental Variables Ethan Kaplan 1 Instrumental Variables: Intro. Bias in OLS: Consider a linear model: Y = X + Suppose that then OLS yields: cov (X; ) = ^ OLS = X 0 X 1 X 0 Y = X 0 X 1 X 0 (X + ) =)

More information

Wooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares

Wooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares Wooldridge, Introductory Econometrics, 4th ed. Chapter 15: Instrumental variables and two stage least squares Many economic models involve endogeneity: that is, a theoretical relationship does not fit

More information

The Multivariate Gaussian Distribution [DRAFT]

The Multivariate Gaussian Distribution [DRAFT] The Multivariate Gaussian Distribution DRAFT David S. Rosenberg Abstract This is a collection of a few key and standard results about multivariate Gaussian distributions. I have not included many proofs,

More information

What is A + B? What is A B? What is AB? What is BA? What is A 2? and B = QUESTION 2. What is the reduced row echelon matrix of A =

What is A + B? What is A B? What is AB? What is BA? What is A 2? and B = QUESTION 2. What is the reduced row echelon matrix of A = STUDENT S COMPANIONS IN BASIC MATH: THE ELEVENTH Matrix Reloaded by Block Buster Presumably you know the first part of matrix story, including its basic operations (addition and multiplication) and row

More information

Missing dependent variables in panel data models

Missing dependent variables in panel data models Missing dependent variables in panel data models Jason Abrevaya Abstract This paper considers estimation of a fixed-effects model in which the dependent variable may be missing. For cross-sectional units

More information

1 Correlation between an independent variable and the error

1 Correlation between an independent variable and the error Chapter 7 outline, Econometrics Instrumental variables and model estimation 1 Correlation between an independent variable and the error Recall that one of the assumptions that we make when proving the

More information

A Course in Applied Econometrics Lecture 14: Control Functions and Related Methods. Jeff Wooldridge IRP Lectures, UW Madison, August 2008

A Course in Applied Econometrics Lecture 14: Control Functions and Related Methods. Jeff Wooldridge IRP Lectures, UW Madison, August 2008 A Course in Applied Econometrics Lecture 14: Control Functions and Related Methods Jeff Wooldridge IRP Lectures, UW Madison, August 2008 1. Linear-in-Parameters Models: IV versus Control Functions 2. Correlated

More information

Applied Health Economics (for B.Sc.)

Applied Health Economics (for B.Sc.) Applied Health Economics (for B.Sc.) Helmut Farbmacher Department of Economics University of Mannheim Autumn Semester 2017 Outlook 1 Linear models (OLS, Omitted variables, 2SLS) 2 Limited and qualitative

More information

ECNS 561 Multiple Regression Analysis

ECNS 561 Multiple Regression Analysis ECNS 561 Multiple Regression Analysis Model with Two Independent Variables Consider the following model Crime i = β 0 + β 1 Educ i + β 2 [what else would we like to control for?] + ε i Here, we are taking

More information

Lecture 8: Instrumental Variables Estimation

Lecture 8: Instrumental Variables Estimation Lecture Notes on Advanced Econometrics Lecture 8: Instrumental Variables Estimation Endogenous Variables Consider a population model: y α y + β + β x + β x +... + β x + u i i i i k ik i Takashi Yamano

More information

Notes 11: OLS Theorems ECO 231W - Undergraduate Econometrics

Notes 11: OLS Theorems ECO 231W - Undergraduate Econometrics Notes 11: OLS Theorems ECO 231W - Undergraduate Econometrics Prof. Carolina Caetano For a while we talked about the regression method. Then we talked about the linear model. There were many details, but

More information

Intermediate Econometrics

Intermediate Econometrics Intermediate Econometrics Markus Haas LMU München Summer term 2011 15. Mai 2011 The Simple Linear Regression Model Considering variables x and y in a specific population (e.g., years of education and wage

More information

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem.

Dot Products. K. Behrend. April 3, Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Dot Products K. Behrend April 3, 008 Abstract A short review of some basic facts on the dot product. Projections. The spectral theorem. Contents The dot product 3. Length of a vector........................

More information

Instrumental Variables and GMM: Estimation and Testing. Steven Stillman, New Zealand Department of Labour

Instrumental Variables and GMM: Estimation and Testing. Steven Stillman, New Zealand Department of Labour Instrumental Variables and GMM: Estimation and Testing Christopher F Baum, Boston College Mark E. Schaffer, Heriot Watt University Steven Stillman, New Zealand Department of Labour March 2003 Stata Journal,

More information

Instrumental Variables

Instrumental Variables Università di Pavia 2010 Instrumental Variables Eduardo Rossi Exogeneity Exogeneity Assumption: the explanatory variables which form the columns of X are exogenous. It implies that any randomness in the

More information

Math 5a Reading Assignments for Sections

Math 5a Reading Assignments for Sections Math 5a Reading Assignments for Sections 4.1 4.5 Due Dates for Reading Assignments Note: There will be a very short online reading quiz (WebWork) on each reading assignment due one hour before class on

More information

Simultaneous Equations and Weak Instruments under Conditionally Heteroscedastic Disturbances

Simultaneous Equations and Weak Instruments under Conditionally Heteroscedastic Disturbances Simultaneous Equations and Weak Instruments under Conditionally Heteroscedastic Disturbances E M. I and G D.A. P Michigan State University Cardiff University This version: July 004. Preliminary version

More information

Dealing With Endogeneity

Dealing With Endogeneity Dealing With Endogeneity Junhui Qian December 22, 2014 Outline Introduction Instrumental Variable Instrumental Variable Estimation Two-Stage Least Square Estimation Panel Data Endogeneity in Econometrics

More information

Recent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data

Recent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data Recent Advances in the Field of Trade Theory and Policy Analysis Using Micro-Level Data July 2012 Bangkok, Thailand Cosimo Beverelli (World Trade Organization) 1 Content a) Endogeneity b) Instrumental

More information

Algebra Exam. Solutions and Grading Guide

Algebra Exam. Solutions and Grading Guide Algebra Exam Solutions and Grading Guide You should use this grading guide to carefully grade your own exam, trying to be as objective as possible about what score the TAs would give your responses. Full

More information

A quadratic expression is a mathematical expression that can be written in the form 2

A quadratic expression is a mathematical expression that can be written in the form 2 118 CHAPTER Algebra.6 FACTORING AND THE QUADRATIC EQUATION Textbook Reference Section 5. CLAST OBJECTIVES Factor a quadratic expression Find the roots of a quadratic equation A quadratic expression is

More information

Discussion of Sensitivity and Informativeness under Local Misspecification

Discussion of Sensitivity and Informativeness under Local Misspecification Discussion of Sensitivity and Informativeness under Local Misspecification Jinyong Hahn April 4, 2019 Jinyong Hahn () Discussion of Sensitivity and Informativeness under Local Misspecification April 4,

More information

Wooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model

Wooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model Wooldridge, Introductory Econometrics, 4th ed. Chapter 2: The simple regression model Most of this course will be concerned with use of a regression model: a structure in which one or more explanatory

More information

Discrete Dependent Variable Models

Discrete Dependent Variable Models Discrete Dependent Variable Models James J. Heckman University of Chicago This draft, April 10, 2006 Here s the general approach of this lecture: Economic model Decision rule (e.g. utility maximization)

More information

Econometrics Summary Algebraic and Statistical Preliminaries

Econometrics Summary Algebraic and Statistical Preliminaries Econometrics Summary Algebraic and Statistical Preliminaries Elasticity: The point elasticity of Y with respect to L is given by α = ( Y/ L)/(Y/L). The arc elasticity is given by ( Y/ L)/(Y/L), when L

More information

5.1 Simplifying Rational Expressions

5.1 Simplifying Rational Expressions 5. Simplifying Rational Expressions Now that we have mastered the process of factoring, in this chapter, we will have to use a great deal of the factoring concepts that we just learned. We begin with the

More information

Lecture 14. More on using dummy variables (deal with seasonality)

Lecture 14. More on using dummy variables (deal with seasonality) Lecture 14. More on using dummy variables (deal with seasonality) More things to worry about: measurement error in variables (can lead to bias in OLS (endogeneity) ) Have seen that dummy variables are

More information

0.1. Linear transformations

0.1. Linear transformations Suggestions for midterm review #3 The repetitoria are usually not complete; I am merely bringing up the points that many people didn t now on the recitations Linear transformations The following mostly

More information

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1

Inverse of a Square Matrix. For an N N square matrix A, the inverse of A, 1 Inverse of a Square Matrix For an N N square matrix A, the inverse of A, 1 A, exists if and only if A is of full rank, i.e., if and only if no column of A is a linear combination 1 of the others. A is

More information

Specification Errors, Measurement Errors, Confounding

Specification Errors, Measurement Errors, Confounding Specification Errors, Measurement Errors, Confounding Kerby Shedden Department of Statistics, University of Michigan October 10, 2018 1 / 32 An unobserved covariate Suppose we have a data generating model

More information

ECON Introductory Econometrics. Lecture 16: Instrumental variables

ECON Introductory Econometrics. Lecture 16: Instrumental variables ECON4150 - Introductory Econometrics Lecture 16: Instrumental variables Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 12 Lecture outline 2 OLS assumptions and when they are violated Instrumental

More information

Chapter 0 of Calculus ++, Differential calculus with several variables

Chapter 0 of Calculus ++, Differential calculus with several variables Chapter of Calculus ++, Differential calculus with several variables Background material by Eric A Carlen Professor of Mathematics Georgia Tech Spring 6 c 6 by the author, all rights reserved - Table of

More information

Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008

Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008 MATH-LITERACY MANUAL Dr. Relja Vulanovic Professor of Mathematics Kent State University at Stark c 2008 2 Algebraic Epressions 2.1 Terms and Factors 29 2.2 Types of Algebraic Epressions 32 2.3 Transforming

More information

Linear Models in Econometrics

Linear Models in Econometrics Linear Models in Econometrics Nicky Grant At the most fundamental level econometrics is the development of statistical techniques suited primarily to answering economic questions and testing economic theories.

More information

Linear Regression. Junhui Qian. October 27, 2014

Linear Regression. Junhui Qian. October 27, 2014 Linear Regression Junhui Qian October 27, 2014 Outline The Model Estimation Ordinary Least Square Method of Moments Maximum Likelihood Estimation Properties of OLS Estimator Unbiasedness Consistency Efficiency

More information

Next is material on matrix rank. Please see the handout

Next is material on matrix rank. Please see the handout B90.330 / C.005 NOTES for Wednesday 0.APR.7 Suppose that the model is β + ε, but ε does not have the desired variance matrix. Say that ε is normal, but Var(ε) σ W. The form of W is W w 0 0 0 0 0 0 w 0

More information

Multiple Linear Regression CIVL 7012/8012

Multiple Linear Regression CIVL 7012/8012 Multiple Linear Regression CIVL 7012/8012 2 Multiple Regression Analysis (MLR) Allows us to explicitly control for many factors those simultaneously affect the dependent variable This is important for

More information

Interpreting Regression Results

Interpreting Regression Results Interpreting Regression Results Carlo Favero Favero () Interpreting Regression Results 1 / 42 Interpreting Regression Results Interpreting regression results is not a simple exercise. We propose to split

More information

ECONOMETRICS FIELD EXAM Michigan State University May 9, 2008

ECONOMETRICS FIELD EXAM Michigan State University May 9, 2008 ECONOMETRICS FIELD EXAM Michigan State University May 9, 2008 Instructions: Answer all four (4) questions. Point totals for each question are given in parenthesis; there are 00 points possible. Within

More information

Chapter 6: Endogeneity and Instrumental Variables (IV) estimator

Chapter 6: Endogeneity and Instrumental Variables (IV) estimator Chapter 6: Endogeneity and Instrumental Variables (IV) estimator Advanced Econometrics - HEC Lausanne Christophe Hurlin University of Orléans December 15, 2013 Christophe Hurlin (University of Orléans)

More information

CAAM 454/554: Stationary Iterative Methods

CAAM 454/554: Stationary Iterative Methods CAAM 454/554: Stationary Iterative Methods Yin Zhang (draft) CAAM, Rice University, Houston, TX 77005 2007, Revised 2010 Abstract Stationary iterative methods for solving systems of linear equations are

More information

Updated: January 16, 2016 Calculus II 7.4. Math 230. Calculus II. Brian Veitch Fall 2015 Northern Illinois University

Updated: January 16, 2016 Calculus II 7.4. Math 230. Calculus II. Brian Veitch Fall 2015 Northern Illinois University Math 30 Calculus II Brian Veitch Fall 015 Northern Illinois University Integration of Rational Functions by Partial Fractions From algebra, we learned how to find common denominators so we can do something

More information

Statistics 910, #5 1. Regression Methods

Statistics 910, #5 1. Regression Methods Statistics 910, #5 1 Overview Regression Methods 1. Idea: effects of dependence 2. Examples of estimation (in R) 3. Review of regression 4. Comparisons and relative efficiencies Idea Decomposition Well-known

More information

Multiple Regression Analysis. Part III. Multiple Regression Analysis

Multiple Regression Analysis. Part III. Multiple Regression Analysis Part III Multiple Regression Analysis As of Sep 26, 2017 1 Multiple Regression Analysis Estimation Matrix form Goodness-of-Fit R-square Adjusted R-square Expected values of the OLS estimators Irrelevant

More information

Fixed Effects Models for Panel Data. December 1, 2014

Fixed Effects Models for Panel Data. December 1, 2014 Fixed Effects Models for Panel Data December 1, 2014 Notation Use the same setup as before, with the linear model Y it = X it β + c i + ɛ it (1) where X it is a 1 K + 1 vector of independent variables.

More information

Generalized Method of Moments (GMM) Estimation

Generalized Method of Moments (GMM) Estimation Econometrics 2 Fall 2004 Generalized Method of Moments (GMM) Estimation Heino Bohn Nielsen of29 Outline of the Lecture () Introduction. (2) Moment conditions and methods of moments (MM) estimation. Ordinary

More information

Specification Test for Instrumental Variables Regression with Many Instruments

Specification Test for Instrumental Variables Regression with Many Instruments Specification Test for Instrumental Variables Regression with Many Instruments Yoonseok Lee and Ryo Okui April 009 Preliminary; comments are welcome Abstract This paper considers specification testing

More information

[y i α βx i ] 2 (2) Q = i=1

[y i α βx i ] 2 (2) Q = i=1 Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation

More information

Control Function and Related Methods: Nonlinear Models

Control Function and Related Methods: Nonlinear Models Control Function and Related Methods: Nonlinear Models Jeff Wooldridge Michigan State University Programme Evaluation for Policy Analysis Institute for Fiscal Studies June 2012 1. General Approach 2. Nonlinear

More information

Eco517 Fall 2014 C. Sims FINAL EXAM

Eco517 Fall 2014 C. Sims FINAL EXAM Eco517 Fall 2014 C. Sims FINAL EXAM This is a three hour exam. You may refer to books, notes, or computer equipment during the exam. You may not communicate, either electronically or in any other way,

More information

FNCE 926 Empirical Methods in CF

FNCE 926 Empirical Methods in CF FNCE 926 Empirical Methods in CF Lecture 2 Linear Regression II Professor Todd Gormley Today's Agenda n Quick review n Finish discussion of linear regression q Hypothesis testing n n Standard errors Robustness,

More information

The Estimation of Simultaneous Equation Models under Conditional Heteroscedasticity

The Estimation of Simultaneous Equation Models under Conditional Heteroscedasticity The Estimation of Simultaneous Equation Models under Conditional Heteroscedasticity E M. I and G D.A. P University of Alicante Cardiff University This version: April 2004. Preliminary and to be completed

More information

Econometric Methods. Prediction / Violation of A-Assumptions. Burcu Erdogan. Universität Trier WS 2011/2012

Econometric Methods. Prediction / Violation of A-Assumptions. Burcu Erdogan. Universität Trier WS 2011/2012 Econometric Methods Prediction / Violation of A-Assumptions Burcu Erdogan Universität Trier WS 2011/2012 (Universität Trier) Econometric Methods 30.11.2011 1 / 42 Moving on to... 1 Prediction 2 Violation

More information

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors

IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors IV Estimation and its Limitations: Weak Instruments and Weakly Endogeneous Regressors Laura Mayoral IAE, Barcelona GSE and University of Gothenburg Gothenburg, May 2015 Roadmap of the course Introduction.

More information

Math Lecture 3 Notes

Math Lecture 3 Notes Math 1010 - Lecture 3 Notes Dylan Zwick Fall 2009 1 Operations with Real Numbers In our last lecture we covered some basic operations with real numbers like addition, subtraction and multiplication. This

More information

Introductory Econometrics

Introductory Econometrics Based on the textbook by Wooldridge: : A Modern Approach Robert M. Kunst robert.kunst@univie.ac.at University of Vienna and Institute for Advanced Studies Vienna November 23, 2013 Outline Introduction

More information

MATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION

MATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether

More information

Chapter 1. GMM: Basic Concepts

Chapter 1. GMM: Basic Concepts Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating

More information

11. Further Issues in Using OLS with TS Data

11. Further Issues in Using OLS with TS Data 11. Further Issues in Using OLS with TS Data With TS, including lags of the dependent variable often allow us to fit much better the variation in y Exact distribution theory is rarely available in TS applications,

More information

The LIML Estimator Has Finite Moments! T. W. Anderson. Department of Economics and Department of Statistics. Stanford University, Stanford, CA 94305

The LIML Estimator Has Finite Moments! T. W. Anderson. Department of Economics and Department of Statistics. Stanford University, Stanford, CA 94305 The LIML Estimator Has Finite Moments! T. W. Anderson Department of Economics and Department of Statistics Stanford University, Stanford, CA 9435 March 25, 2 Abstract The Limited Information Maximum Likelihood

More information

Econ 2148, fall 2017 Instrumental variables II, continuous treatment

Econ 2148, fall 2017 Instrumental variables II, continuous treatment Econ 2148, fall 2017 Instrumental variables II, continuous treatment Maximilian Kasy Department of Economics, Harvard University 1 / 35 Recall instrumental variables part I Origins of instrumental variables:

More information

Motivation for multiple regression

Motivation for multiple regression Motivation for multiple regression 1. Simple regression puts all factors other than X in u, and treats them as unobserved. Effectively the simple regression does not account for other factors. 2. The slope

More information

( ) is called the dependent variable because its

( ) is called the dependent variable because its page 1 of 16 CLASS NOTES: 3 8 thru 4 3 and 11 7 Functions, Exponents and Polynomials 3 8: Function Notation A function is a correspondence between two sets, the domain (x) and the range (y). An example

More information

1 The Multiple Regression Model: Freeing Up the Classical Assumptions

1 The Multiple Regression Model: Freeing Up the Classical Assumptions 1 The Multiple Regression Model: Freeing Up the Classical Assumptions Some or all of classical assumptions were crucial for many of the derivations of the previous chapters. Derivation of the OLS estimator

More information

Lecture 4: Testing Stuff

Lecture 4: Testing Stuff Lecture 4: esting Stuff. esting Hypotheses usually has three steps a. First specify a Null Hypothesis, usually denoted, which describes a model of H 0 interest. Usually, we express H 0 as a restricted

More information

What s New in Econometrics. Lecture 13

What s New in Econometrics. Lecture 13 What s New in Econometrics Lecture 13 Weak Instruments and Many Instruments Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Motivation 3. Weak Instruments 4. Many Weak) Instruments

More information

ECON2228 Notes 2. Christopher F Baum. Boston College Economics. cfb (BC Econ) ECON2228 Notes / 47

ECON2228 Notes 2. Christopher F Baum. Boston College Economics. cfb (BC Econ) ECON2228 Notes / 47 ECON2228 Notes 2 Christopher F Baum Boston College Economics 2014 2015 cfb (BC Econ) ECON2228 Notes 2 2014 2015 1 / 47 Chapter 2: The simple regression model Most of this course will be concerned with

More information

5.2. a. Unobserved factors that tend to make an individual healthier also tend

5.2. a. Unobserved factors that tend to make an individual healthier also tend SOLUTIONS TO CHAPTER 5 PROBLEMS ^ ^ ^ ^ 5.1. Define x _ (z,y ) and x _ v, and let B _ (B,r ) be OLS estimator 1 1 1 1 ^ ^ ^ ^ from (5.5), where B = (D,a ). Using the hint, B can also be obtained by 1 1

More information