Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited
|
|
- Jade Norris
- 5 years ago
- Views:
Transcription
1 Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited Yingying Dong and Shu Shen UC Irvine and UC Davis Sept Chicago 1 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
2 Introduction Motivation: QTE/LQTE Literature In program evaluations, applied researchers care about treatment effect heterogeneity and often look at distributional/quantile effects of treatments. In quantile treatment effect (QTE) models, rank invariance or rank similarity is required either for identification: e.g., IVQR model of Chernozhukov and Hansen (2005, 06, 08), Chernozhukov, Imbens, and Newey (2007), Horowitz and Lee (2007). or for interpretation: e.g., LQTE framework (Abadie, Angrist and Imbens, 2002). Also Frolich and Melly (2013), Firpo (2007), and Imbens and Newey (2009). This paper studies the assumption of (unconditional) rank invariance and rank similarity. provides identification of the distribution of individuals (unconditional) potential ranks conditional on covariates. proposes nonparametric tests that are applicable to both exogenous and endogenous treatments 2 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
3 Introduction Motivation: Program Evaluation Applications The Star Project: the effect of attending a small class (T ) in grade K on student outcome (Y, grade K test score) Figure: The Star Project Score Distributions Probability Total Score QTE Regular Class With Aid Small Class Regular Class 3 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
4 Introduction Motivation: Program Evaluation Applications JTPA (Job Training Partnership Act): the effect of job training (T ) on individual earnings (Y ). Randomly assigned (Z) treatment with about 60% compliance rate. Potential Earnings Distributions, Female Potential Earnings Distributions Among Compiers, Male Probability Probability Earnings Earnings LQTE Control Treatment LQTE Control Treatment 4 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
5 Introduction Definition of Rank Invariance Y 0 and Y 1 are the potential outcomes under no treatment and under treatment, respectively. U t = F t (Y t) U(0, 1) is the rank of the potential outcome Y t. U 0 and U 1 are unconditional and are never observed at the same time. Rank invariance is the condition that U 0 = U 1 Example: Y t = g t (X, V ), where Y t is test score, X is observed characteristics such as gender, race, and V is ability. If (X, V ) : Ω W, so that U t = F t (g t (X(ω), V (ω))), then rank invariance is says that U 0 (ω) = U 1 (ω) for all ω Ω. Let q t(τ) = F 1 Y t (τ) and QTE(τ) = q 1 (τ) q 0 (τ). Rank invaraince implies that QTE(τ) is the individual treatment effect for anyone who is at quantile τ. Rank invariance is restrictive does not allow for random slippages in potential ranks (e.g., caused by luck). 5 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
6 Introduction Rank Similarity Suppose Y t = g t (X, V, S t), where X (gender, race) and V (ability) determine the common rank level, S t (luck) is a random shock (luck) responsible for the random slippages. S t is realized after a treatment is assigned. Rank similarity is the condition that U 0 (X = x, V = v) U 1 (X = x, V = v) for all (x, v) W. If (X, V ) : Ω W, then rank similarity says that U 0 (ω) U 1 (ω) for all ω Ω. 6 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
7 Introduction Implications of Rank Similarity Rank similarity implies that Lemma 1 1 The distributions of observables and unobservables at the same rank are the same across treatment states. That is, Given rank similarity, F X,V U0 (x, v τ) = F X,V U1 (x, v τ), for all τ (0, 1), (x, v) W. 2 For any individual, her average treatment effect is a weighted average of the unconditional QTEs, where the weights are the individual s probabilities of being at different quantiles. That is, 1 Given rank similarity, E [Y 1 Y 0 X = x, V = v] = QTE(τ)dF U X,V (τ x, v) for all (x, v) W 0 3 (Main Testable Implication) Treatment should not affect the distribution of ranks among observationally equivalent individuals. That is, Given rank similarity, F U0 X(τ x) = F U1 X(τ x), for all τ (0, 1), x X. 7 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
8 Identification Exogenous Treatment Identification: the Exogenous Treatment Case If T is exogenous, identification of F U1 X(τ x) F U0 X (τ x) for τ (0, 1) and x X is trivial: F U1 X(τ x) F U0 X (τ x) = E ( 1(U 1 τ) X = x ) E ( 1(U 0 τ)) X = x ) = E ( 1(Y 1 q 1 (τ) X = x ) E ( 1(Y 0 q 0 (τ)) X = x ) = E ( 1(Y q 1 (τ)) X = x, T = 1 ) E ( 1(Y q 0 (τ)) X = x, T = 0 ), where marginal quantiles q 1 (τ) and q 0 (τ) are directly identified from sub-samples with T = 1 and T = 0, respectively. 8 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
9 Identification Endogenous Treatment Identification: the Endogenous Treatment Case If T is endogenous, let Z = 0, 1 be an IV, and T z for z = 0, 1 be potential treatment status. Interested in testing for rank similarity among compliers (T 1 > T 0 ): F U1 C,X(τ x) = F U0 C,X(τ x) for all τ (0, 1) and x X C, where X C = {x X : Pr [T 1 > T 0 X = x] > 0}. Assumption 1 Let (Y t, T t, X, Z), t = 0, 1 be random variables mapped from the common probability space (Ω, F, P). The following conditions hold jointly with probability one. 1 Independence: (Y 0, Y 1, T 0, T 1 ) Z X. 2 First stage: E(T 1 ) E(T 0 ). 3 Monotonicity: Pr(T 1 T 0 ) =1. 4 Nontrivial assignment: 0 < Pr (Z = 1 X = x) < 1 for all x X. 9 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
10 Identification Endogenous Treatment Identification: the Endogenous Treatment Case Theorem 1 Let I (τ) 1 ( Y ( Tq 1 C (τ) + (1 T ) q 0 C (τ) )). Given Assumption 1, for all τ (0, 1), x X C, and t = 0, 1, F Ut C,X(τ x) is identified and is given by F Ut C,X(τ x) = E [I (τ)1 (T = t) Z = 1, X = x] E [I (τ)1 (T = t) Z = 0, X = x]. (1) E[1 (T = t) Z = 1, X = x] E[1 (T = t) Z = 0, X = x] F U1 C,X(. x) = F U0 C,X(. x) for x X C if and only if for all τ (0, 1) and x X Note: I (τ) is a rank indicator. E [I (τ) Z = 1, X = x] = E [I (τ) Z = 0, X = x]. (2) Notice the change from x X C to x X in the theorem. This is because Equation (2) holds trivially for X /X C. Use the identification result of Equation (2) to test for H 0 : F U1 C,X(. x) = F U0 C,X(. x). Use the identification result of Equation (1) to estimate F U1 C,X(. x) F U0 C,X(. x). 10 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
11 Identification Endogenous Treatment Mean Test Theorem 1 also gives identification of specific features of the potential rank distribution such as the mean. Rank similarity implies F U1 C,X(τ x) = F U0 C,X(τ x) which further implies E[U 1 C, X = x] = E[U 0 C, X = x]. E[U 1 C, X = x] = E[U 0 C, X = x] holds if and only if E [U Z = 1, X = x] = E [U Z = 0, X = x], where U TU 1 + (1 T )U 0 = (( Tq 1 C (τ) + (1 T )q 0 C (τ) ) < Y ) dτ = I (τ)dτ. U is identified because I (τ) is identified. E[U 1 C, X = x] E[U 0 C, X = x] represents the average rank change for each subpopulation. 11 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
12 Identification Endogenous Treatment Star Project: Small Classes V.s. Regular Classes Rank Distributions by Race Rank Distributions by Gender Probability Probability Rank of Total Score Rank of Total Score Nonwhite, Small Class White, Small Class Nonwhite, Regular Class White, Regular Class Boy, Small Class Girl, Small Class Boy, Regular Class Girl, Regular Class Regular Class with Aid V.s. Regular Classes Rank Distributions by Race Rank Distributions by Gender Probability Probability Rank of Total Score Rank of Total Score 12 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
13 Identification Endogenous Treatment Empirical Example: JTPA Female Potential Rank Distributions, by Education Potential Rank Distributions, by Employment Last Year Probability Probability Rank Rank <HS, Treatment HS, Treatment <HS, Control HS, Control <13 Weeks, Treatment <13 Weeks, Control >=13 Weeks, Treatment >=13 Weeks, Control Male Potential Rank Distributions by Education Potential Rank Distributions by Employment Last Year Probability Probability Rank Rank 13 / 37 <HS, Treatment <HS, Control Dong, Shen Testing<13 forweeks, Rank Treatment Invariance or Similarity <13 Weeks, in Program ControlEvaluation
14 Identification Endogenous Treatment Null Hypothesis and Test Statistic Let X = {x 1, x 2,..., x J }, Ω = {τ 1, τ 2,..., τ K } H 0 : m 0 j (τ k) = m 1 j (τ k) for j = 1,..., J 1 and k = 1,..., K, for z = 0, 1 m z j (τ k ) E [ 1 ( Y Tq 1 C (τ k ) + (1 T )q 0 C (τ k ) ) Z = z, X = x j ]. ˆm z j (τ k ) = 1 n z j where ˆω i ( Zi Z i =z,x i =x j 1 ( Y i T i ˆq 1 C (τ k ) + (1 T i )ˆq 0 C (τ k ) ), with (ˆq0 C (τ k ), ˆq 1 C (τ k ) ) 1 = arg min q 0,q 1 n π(x i ) 1 Z i 1 π(x i ) n ρ τk (Y i q 0 (1 T i ) q 1 T i )ˆω i, i=1 ) (2T i 1) and π(x) is a consistent estimator of π(x) = Pr (Z = 1 X = x), and n z j = n i=1 1(Z i = z, X i = x j ). Wald-type test: W n ( ˆm 1 ˆm 0) ˆV 1 ( ˆm 1 ˆm 0). 14 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
15 Identification Endogenous Treatment Assumption for Asymptotic Properties Assumption 3 1 i.i.d. data: the data (Y i, T i, Z i, X i ) for i = 1,..., n is a random sample of size n from (Y, T, Z, X). 2 For all τ Ω = {τ 1, τ 2,..., τ K }, the random variable Y 1 and Y 0 are continuously distributed with positive density in a neighborhood of q 0 C (τ) and q 1 C (τ) in the subpopulation of compliers. 3 For all j = 1,..., J, ˆπ(x j ) is consistent, or ˆπ ( x j ) p π ( xj ). 4 Let f Y T,Z,X be the conditional density of Y given T, Z and X. For all t, z = 0, 1, j = 1,..., J and τ Ω, f Y T,Z,X (y t, z, x j ) has bounded first derivative with respect to y in a neighborhood of q t C (τ). Let f Y X (y x) be the conditional density of Y given X. For all τ Ω and j = 1,..., J, f Y X (. x j ) is positive and bounded in a neighborhood of q t C (τ). 15 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
16 Identification Endogenous Treatment Asymptotics Let ˆm z, z = 0, 1, be K(J 1) dimentional vector with K(j 1) + k-th element ˆm j z (τ k). Theorem 2 Given Assumptions 1 and 3, ( n ˆm 1 ˆm 0 ( m 1 m 0)) N(0, V) where ( V is the K(J 1) K(J 1) asymptotic variance-covariance matrix. The J 1 j=1 K(j 1) + k, J 1 j =1 K(j 1) + k )-th element of V is equal to [( ) ( )] E φ 1 j (τ k) φ 0 j (τ k) φ 1 j (τ k ) φ 0 j (τ k ) with φ z j (τ k) φ z j (τ k; Y, T, Z, X) = I (τ k) mj z (τ k) 1(Z = z, X = x j ) p Z,X (z, x j ) f Y T,Z,X(q 0 C (τ k ) 0, z, x j )(1 p T Z,X (z, x j )) ψ 0 (Y, T, Z, X) P cf 0 C (q 0 C (τ k )) f Y T,Z,X(q 1 C (τ k ) 1, z, x j )p T Z,X (z, x j ) ψ 1 (Y, T, Z, X), P cf 1 C (q 1 C (τ k )) where ψ 0 (Y, T, Z, X) and ψ 1 (Y, T, Z, X) are defined in the proof of Theorem 7 in Frolich and Melly (2007), and restated in the proof of this theorem in the Appendix. 16 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
17 Identification Endogenous Treatment Asymptotic Properties of the Test Remember the Wald-type test statistic W n ( ˆm 1 ˆm 0) ˆV 1 ( ˆm 1 ˆm 0) χ 2 (K(J 1)) under the null. Bootstrap ˆV. If q 0 C (τ k ) and q 1 C (τ k ) were known, φ z j (τ k ; Y, T, Z, X) would reduce to I (τ k ) m j z (τ k ) ( J 1 1(Z = z, X = x p Z,X (z,x j ) j ) and the j=1 K(j 1) + k, J 1 j K(j 1) + k ) -th element of =1 V is equal to z=0,1 mz j (τ k τ k ) m z j (τ k )m z j (τ k ) if j = j, and 0 if j j. If J is very large, then the first stage estimation error may be ignored and one can construct ˆV by the analytic formula. Discussed in extensions where J or X includes continuous variables. The critical value c α is the (1 α) 100-th percentile of the χ 2 (K(J 1)) distribution. The test is consistent for the null hypothesis H 0 Once again, the test does NOT test the unobservable part (e.g. V or ability) of the rank invariance assumption. 17 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
18 Identification Endogenous Treatment The Mean Rank Similarity Test Let m z j = E[U Z = z, X = x j ] for z = 0, 1. H 0,mean : m j 0 = m j 1, for all j = 1,..., J 1. Let {τ s } S x =1 be S random draws from U (0, 1). Ûi T Û1i + (1 T )Û0i for i = 1,..., n, can be estimated by Û i = 1 S 1 (( T ˆq 1 C (τ s ) + (1 T )ˆq 0 C (τ s ) ) ) Y i, S s=1 m z j can then be estimated by m z j = 1 n z j Z i =z,x i =x j Û i. 18 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
19 Identification Endogenous Treatment The Mean Rank Similarity Test Corollary 3 Suppose Assumptions 1 and 3 hold for Ω = (0, 1). Under the null hypothesis where m 1 = m 0, when S, n n ( m 1 m 0) N(0, V mean), where V mean is the (J [( 1) (J 1) asymptotic variance-covariance matrix. The (j, j )-th element of V mean is E 1 0 φ1 j (τ)dτ ) ( 1 0 φ0 j (τ)dτ 1 0 φ1 j (τ)dτ )] 1 0 φ0 j (τ)dτ, where 1 φ z j (τ)dτ = U mz j 0 p Z,X (z, x j ) 1(Z = z, X = x j ) ( 1 f Y T,Z,X (q 0 C (τ) 0, z, x j ) 1 PT Z,X (z, x j ) ) ψ 0 (Y, T, Z, X) dτ 0 f 0 C (q 0 C (τ)) P c 1 f Y T,Z,X (q 1 C (τ) 1, z, x j ) dτ P T Z,X(z, x j )ψ 1 (Y, T, Z, X). 0 f 1 C (q 1 C (τ)) P c A Wald-type test statistic is then as N, J, N/J. W mean n ( m 1 m 0) V 1 ( m 1 m 0) χ 2 (J 1) 19 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
20 Simulation and JTPA Simulation Simulation: DGPs DGP: Y 0 = X + V + S 0, Y 1 = X + V + (1 bxv ) + S 1, Y = Y 1 T + Y 0 (1 T ), Pr(X = 0.4j) = 1/5 for j = 1,..., 5, V, S 0, S 1 N(0, 1) and b = 0, 2. Exogenous treatment: Pr(T = t) = 1 2, t = 0, 1. Endogenous treatment: Pr(Z = z) = 1 2, z = 0, 1, and T = 1 (0.15(Y1 Y0) + Z 0.5 > 0). Rank similarity holds when b = 0 but not when b / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
21 Simulation and JTPA Simulation Illustration of DGPs: Exogenous Treatment Figure: Conditional distributions of potential ranks b=0 b=1 Conditional CDF Conditional CDF Potential rank Potential rank X=0.4, Y(1) X=0.8, Y(1) X=1.2, Y(1) X=1.6, Y(1) X=2.0, Y(1) X=0.4, Y(0) X=0.8, Y(0) X=1.2, Y(0) X=1.6, Y(0) X=2.0, Y(0) X=0.4, Y(1) X=0.8, Y(1) X=1.2, Y(1) X=1.6, Y(1) X=2.0, Y(1) X=0.4, Y(0) X=0.8, Y(0) X=1.2, Y(0) X=1.6, Y(0) X=2.0, Y(0) b=2 b=3 Conditional CDF Conditional CDF Potential rank Potential ranks X=0.4, Y(1) X=0.8, Y(1) X=1.2, Y(1) X=1.6, Y(1) X=2.0, Y(1) X=0.4, Y(0) X=0.8, Y(0) X=1.2, Y(0) X=1.6, Y(0) X=2.0, Y(0) X=0.4, Y(1) X=0.8, Y(1) X=1.2, Y(1) X=1.6, Y(1) X=2.0, Y(1) X=0.4, Y(0) X=0.8, Y(0) X=1.2, Y(0) X=1.6, Y(0) X=2.0, Y(0) 21 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
22 Simulation and JTPA Simulation Simulation Results: Exogenous Treatment N b = 0 b = 1 Test 1: Ω = {0.5} Test 2: Ω = {0.2, 0.3, 0.4} Test 3: Ω = {0.5, 0.6, 0.7, 0.8} Test 4: Ω = {0.2, 0.3,..., 0.8} Test 5: Mean Test b = 2 b = 3 Test 1: Ω = {0.5} Test 2: Ω = {0.2, 0.3, 0.4} Test 3: Ω = {0.5, 0.6, 0.7, 0.8} Test 4: Ω = {0.2, 0.3,..., 0.8} Test 5: Mean Test Sample Size = 1000 b = 2 Rejection Rate Rejection Rate b Distributional Test 1 Distributional Test 2 Distributional Test 3 Distributional Test 4 Mean Test Sample Size Distributional Test 1 Distributional Test 2 Distributional Test 3 Distributional Test 4 Mean Test 22 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
23 Simulation and JTPA Simulation Simulation Results: Endogenous Treatment N b = 0 b = 1 Ω = {0.5} Ω = {0.2, 0.3, 0.4} Ω = {0.5, 0.6, 0.7, 0.8} Ω = {0.2, 0.3,..., 0.8} Mean Test b = 2 b = 3 Ω = {0.5} Ω = {0.2, 0.3, 0.4} Ω = {0.5, 0.6, 0.7, 0.8} Ω = {0.2, 0.3,..., 0.8} Mean Test Sample Size = 1000 b = 2 Rejection Rate Rejection Rate b Distributional Test 1 Distributional Test 2 Distributional Test 3 Distributional Test 4 Mean Test Sample Size Distributional Test 1 Distributional Test 2 Distributional Test 3 Distributional Test 4 Mean Test 23 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
24 Empirical Examples: Testing Results Star Testing: the Exogenous Treatment Case Conclusions Table: Star Project: Test Results Treatment type Total Test Score Birthday (1st-31st) Small Class V.s. Regular Class Test Stat P-value Aid Class V.s. Regular Class Test Stat P-value Both treatments (small class and regular class with aid) improve the rank distribution of the disadvantaged (boy, nonwhite) Assigning a teaching aid to the regular class systematically changes students rank. Researchers may want to reconsider the practice of using both regular class with and without aid as the control group in analysis. 24 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
25 Empirical Examples: Testing Results Star Empirical Example: JTPA Y = 30 months earnings following assignment T = receiving training services, Z = random assignment indicator, X = black, Hispanic, HS or GED, married, worked at least 13 weeks the year before, AFDC receipt (for women only) and 5 age category dummies. (Abadie, Angrist and Imbens, 2002) 25 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
26 Empirical Examples: Testing Results JTPA JTPF: First-Stage Unconditional LQTE Estimation Table: First-stage estimates of unconditional QTEs of training on trainee earnings Female Male Quantile Y 0 QTE Y 0 QTE (341.88) 1, (713.36) (358.31)* 2, (723.01) ,458 1,200 (372.08)*** 4, (746.85) ,463 1,380 (399.21)*** 6, (891.74) ,784 1,705 (497.01)*** 8, (1,042.40) ,271 1,974 (669.75)*** 11, (1,104.63) ,726 2,451 (766.25)*** 13,104 1,069 (1,144.28) ,685 2,436 (829.29)*** 15,374 1,291 (1,234.59) ,007 2,089 (877.56)** 17,357 2,239 (1,295.79)* ,618 2,729 (886.96)*** 20,409 2,118 (1,418.40) ,682 2,943 (920.45)*** 23,342 2,319 (1,557.00) ,971 2,772 (1,027.14)*** 27,169 1,780 (1,606.66) ,252 2,106 (1,152.35)* 30,439 2,408 (1,641.47) ,064 2,331 (1,149.71)** 34,620 2,800 (1,701.90)* ,735 1,762 (1,179.91) 39,233 3,955 (1,886.98)** Note: Standard errors are in the parentheses; All estimates control for covariates including dummies for black, Hispanic, high-school graduates (including GED holders), marital status, whether the applicant worked at least 12 weeks in the 12 months preceding random assignment, and AFDC receipt (for women only) as well as 5 age group dummies; * significant at the 10% level, ** significant at the 5% level, ***significant at the 1% level. 26 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
27 Empirical Examples: Testing Results JTPA JTPA: Joint Test Table: Rank similarity test jointly at all quantiles Female Male I II I II (1) (2) (1) (2) (1) (2) (1) (2) Panel A: Dependent Var. Earnings χ 2 7, , , , , , (0.000) (0.000) (0.000) (0.000) (0.000) (0.000) (0.000) (0.000) d.f. 1,544 1, ,218 1, Panel B: Falsification test (Dependent Var. Age) χ (0.926) (0.953) (0.366) (0.245) (1.000) (1.000) (0.977) (0.982) d.f Note: Results are based on the Chi-squared test in Theorem 2; Variance-covariance matrices are bootstrapped with 2,000 replications; P-values are in the parentheses; Columns I report a joint test at equally-spaced 15 quantiles from 0.15 to 0.85; Columns II reports a joint test at equally-spaced 7 quantiles from 0.20 to 0.80; (1) controls for covariates in the first-stage unconditional QTE estimation, while (2) does not; X values with fewer than 5 observations when either Z = 0 or Z = 1 are not used in the test to ensure the common support assumption. 27 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
28 Empirical Examples: Testing Results JTPA JTPA: Test Individual Quantiles Table: Rank similarity test at individual quantiles Panel A: Dependent Var. Earnings Panel B: Falsification test (Dependent Var. Age) Female Male Female Male Quantile χ 2 χ 2 χ 2 χ (0.012) (0.045) 43.9 (0.144) 19.4 (0.561) (0.004) (0.010) 37.9 (0.340) 22.1 (0.391) (0.060) (0.025) 26.0 (0.863) 13.9 (0.907) (0.034) (0.039) 26.9 (0.834) 15.0 (0.861) (0.003) 95.8 (0.142) 22.1 (0.956) 17.9 (0.712) (0.160) 88.6 (0.291) 31.1 (0.659) 23.2 (0.447) (0.387) (0.019) 32.1 (0.611) 22.4 (0.497) (0.304) (0.012) 32.3 (0.599) 19.2 (0.692) (0.266) (0.019) 30.8 (0.673) 19.6 (0.664) (0.276) (0.015) 32.7 (0.581) 22.3 (0.503) (0.113) (0.044) 29.4 (0.734) 18.4 (0.735) (0.375) (0.038) 36.7 (0.388) 24.0 (0.402) (0.035) (0.018) 45.4 (0.112) 16.5 (0.831) (0.128) (0.005) 47.7 (0.074) 17.1 (0.802) (0.697) (0.002) 44.7 (0.125) 18.7 (0.716) Note: Results are based on the Chi-squared test in Theorem 2; Variance-covariance matrices are bootstrapped with 2,000 replications; P-values are in the parentheses; Covariates are controlled for in the first-stage unconditional QTE estimation. X values with fewer than 5 observations when either Z = 1 or Z = 0 are not used in the test to ensure the common support assumption. 28 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
29 Empirical Examples: Testing Results JTPA JTPA: Test the Mean Rank Table: Rank similarity test for the mean rank only Female Male (1) (2) (1) (2) Panel A: Dependent Var. Earnings χ (0.098) (0.098) (0.009) (0.009) d.f Panel B: Falsification test (Dependent Var. Age) χ (0.683) 30.6 (0.683) 18.4 (0.736) 18.4 (0.736) d.f Note: Results are based on the Chi-squared test for the mean ranks only; Variance-covariance matrices are bootstrapped with 2,000 replications; P-values are in the parentheses; (1) controls for covariates in the first-stage unconditional QTE estimation, while (2) does not; X values with fewer than 5 observations when either Z = 1 or Z = 0 are not used in the test to ensure the common support assumption. Conclusion: Training causes some individuals to systemically change their ranks in the earnings distribution. Should be cautious in equating the distributional impacts of training with the true effects on individual trainees. Results largely agree with Heckman, Smith and Clements (1997): perfect positive dependence across potential outcome distributions... not credible. 29 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
30 Extensions Extension I: Covariates with Large Support Assume that J, as n. Assumption 4 1 i.i.d. data: the data {Y i, T i, Z i, X i } for i = 1,..., n is a random sample of size n of (Y, T, Z, X). 2 For all τ Ω = {τ 1, τ 2,..., τ K }, the random variable Y 1 and Y 0 are continuously distributed with positive density in a neighborhood of q 0 C (τ) and q 1 C (τ) in the subpopulation of compliers. 3 Let n j = n i=1 1(X = x j). n j n/j uniformly over j, i.e. there exist 0 < c C < such that c n J n j C n for all j = 1,..., J. J p 4 ˆπ(x j ) is uniformly consistent, or sup j=1,...,j ˆπ(x j ) π(x j ) 0 as n, J and n/j. 5 For all t, z = 0, 1, j = 1,..., J and τ Ω, f Y T,Z,X (. t, z, x j ) is bounded in a neighborhood of q t C (τ). For all τ Ω and j = 1,..., J, f Y X (. x j ) is positive and bounded in a neighborhood of q t C (τ). 30 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
31 Extensions Extension I: Covariates with Large Support Let ˆm z j = ( ˆm z j (τ 1),..., ˆm z j (τ K )) and m z j = (m z j (τ 1),..., m z j (τ K )) be K 1 vector. Corollary 4 Given Assumptions 1 and 4, we have n1 j n0 ( ( )) j nj 1 + nj 0 ˆm 1 j ˆm 0 j m 1 j m 0 j Z j N(0, V j ), where Z j for j = 1,..J follow independent multi-variate normal distributions; the (k, k )-th element of K K variance-covariance matrix ) V j is ) V j;k,k = π(x j )mj 1(τ k τ k ) (1 mj 1(τ k ) + (1 π(x j ))mj 0(τ k τ k ) (1 mj 0(τ k ). 31 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
32 Extensions Extension I: Covariates with Large Support For each j = 1,..., J, define the Wald-type statistic w j = n1 j n0 j nj 1 + nj 0 ( ) ( ) ˆm 1 j ˆm 0 j ˆV 1 j ˆm 1 j ˆm 0 j where ˆV j is a consistent estimator of V j. The (k, k )-th element of ˆV j is ˆV j;k,k = n0 j nj 0 + nj 1 ) ˆm j 1 (τ k τ k ) (1 ˆm j 1 (τ k ) + n1 j nj 0 + nj 1 ) ˆm j 0 (τ k τ k ) (1 ˆm j 0 (τ k ). The test statistic is then W largej = J 1 j=1 w j K(J 1) 2K(J 1) N(0, 1). The one-sided decision rule of the test is to reject the null hypothesis H 0 if W largej > c α. 32 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
33 Extensions Extension II: Continuous Covariates Let m z k (x) = E[I (τ k) Z = z, X = x] for z = 0, 1. Interested in testing H 0 : mk 1 (x) = m0 k (x) for all x X and k = 1,..., K, Apply Chernozhukov, Lee and Rosen (2013) and form Kolmogorov-Smirnov type test statistic: ˆm k 1 KS = sup (x) ˆm0 k (x) k,x s k (x), where ˆm z k (x) is local linear estimator and s k(x) the standard error of ˆm 1 k (x) ˆm0 k (x). Construct the critical value c α by multiplier bootstrap. Let ˆm k (x) is a multiplier process such that ˆm k (x) = Z i =1 η i ˆɛ k,i K h1 (X i x) Z Z i =1 K i =0 η i ˆɛ k,i K h0 (X i x) h 1 (X i x) Z i =0 K h 0 (X i x) where {η i } N i=1 is simulated from i.i.d. N(0, 1) and independent of data, ˆɛ k,i = 1 ( Y i ˆq 1 C (τ k )T i + ˆq 0 C (τ k )(1 T i ) ) ˆm k 1(x i )Z i ˆm k 0(x i )(1 Z i ). c α is the ˆm k (1 α) 100% percentile of the simulated process sup (x) k,x s k (x). Reject the null if KS > c α. 33 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
34 Extensions Extension III: Testing for Conditional Rank Invariance or Similarity Two main modifications are required: 1 First, estimate conditional quantiles conditional on some covariates X 1 of interest. 2 Second, use additional covariates X 2 other than the conditioning covariates in the first-step to perform the test. Feasible only when the conditioning set for the conditional quantiles is small. E.g., we estimate quantiles of potential earnings, and perform tests for male and female trainees, so the tests are essentially rank similarity tests for conditional ranks conditional on gender. 34 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
35 Conclusion Conclusion Proposes nonparametric tests for rank invariance or similarity popular in program evaluation or various QTE models. The tests explore whether the distribution (or features of it) of potential ranks remains the same among observationally equivalent individuals. Simulations show good size and power of the proposed tests in small samples. Empirical application to the JTPA training program: Training causes some individuals to systematically change their ranks in the distribution of earnings. Program effects are more complicated than suggested by standard QTEs. Should be cautious in equating program impacts on the distribution of earnings with those on individual trainees. 35 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
36 Conclusion (Incomplete) Reference List QTE models: Abadie, Angrist and Imbens (2002), Chesher (2003, 2005), Chernozhukov and Hansen (2005, 2006, 2008), Firpo (2007), Firpo, Fortin and Lemieux (2007), Chernozhukov, Imbens and Newey (2007), Horowitz and Lee (2007), Imbens and Newey (2009), Rothe (2010), Frolich and Melly (2013), Powell (2013), Yu (2014), etc. Other works in rank invariance/similarity testing Frandsen and Lefgreen (2015): a parametric test for rank similarity, testing the equality of mean ranks with or without treatment. Yu (2015): a test for rank invariance, assuming unconfoundedness. JTPA: Abadie, Angrist and Imbens (2002), Chernozhukov and Hansen (2008), Orr et al. (1996), Heckman, Smith, and Clements (1997), etc. Star: Krueger (1999), Krueger and Whitmore (2001), Chetty, et. al. (2010), Jackson and Page (2013), etc. 36 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
37 Conclusion Thank you! 37 / 37 Dong, Shen Testing for Rank Invariance or Similarity in Program Evaluation
Testing for Rank Invariance or Similarity in Program Evaluation
Testing for Rank Invariance or Similarity in Program Evaluation Yingying Dong University of California, Irvine Shu Shen University of California, Davis First version, February 2015; this version, October
More informationTesting for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited
Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited Yingying Dong University of California, Irvine Shu Shen University of California, Davis First
More informationA Test for Rank Similarity and Partial Identification of the Distribution of Treatment Effects Preliminary and incomplete
A Test for Rank Similarity and Partial Identification of the Distribution of Treatment Effects Preliminary and incomplete Brigham R. Frandsen Lars J. Lefgren April 30, 2015 Abstract We introduce a test
More informationFlexible Estimation of Treatment Effect Parameters
Flexible Estimation of Treatment Effect Parameters Thomas MaCurdy a and Xiaohong Chen b and Han Hong c Introduction Many empirical studies of program evaluations are complicated by the presence of both
More informationGroupe de lecture. Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings. Abadie, Angrist, Imbens
Groupe de lecture Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings Abadie, Angrist, Imbens Econometrica (2002) 02 décembre 2010 Objectives Using
More informationTesting Rank Similarity
Testing Rank Similarity Brigham R. Frandsen Lars J. Lefgren November 13, 2015 Abstract We introduce a test of the rank invariance or rank similarity assumption common in treatment effects and instrumental
More informationA Test for Rank Similarity and Partial Identification of the Distribution of Treatment Effects Preliminary and incomplete
A Test for Rank Similarity and Partial Identification of the Distribution of Treatment Effects Preliminary and incomplete Brigham R. Frandsen Lars J. Lefgren August 1, 2015 Abstract We introduce a test
More informationThe Econometric Evaluation of Policy Design: Part I: Heterogeneity in Program Impacts, Modeling Self-Selection, and Parameters of Interest
The Econometric Evaluation of Policy Design: Part I: Heterogeneity in Program Impacts, Modeling Self-Selection, and Parameters of Interest Edward Vytlacil, Yale University Renmin University, Department
More informationApplied Microeconometrics. Maximilian Kasy
Applied Microeconometrics Maximilian Kasy 7) Distributional Effects, quantile regression (cf. Mostly Harmless Econometrics, chapter 7) Sir Francis Galton (Natural Inheritance, 1889): It is difficult to
More informationImpact Evaluation Technical Workshop:
Impact Evaluation Technical Workshop: Asian Development Bank Sept 1 3, 2014 Manila, Philippines Session 19(b) Quantile Treatment Effects I. Quantile Treatment Effects Most of the evaluation literature
More informationWORKING P A P E R. Unconditional Quantile Treatment Effects in the Presence of Covariates DAVID POWELL WR-816. December 2010
WORKING P A P E R Unconditional Quantile Treatment Effects in the Presence of Covariates DAVID POWELL WR-816 December 2010 This paper series made possible by the NIA funded RAND Center for the Study of
More informationWeak Stochastic Increasingness, Rank Exchangeability, and Partial Identification of The Distribution of Treatment Effects
Weak Stochastic Increasingness, Rank Exchangeability, and Partial Identification of The Distribution of Treatment Effects Brigham R. Frandsen Lars J. Lefgren December 16, 2015 Abstract This article develops
More informationAn Alternative Assumption to Identify LATE in Regression Discontinuity Designs
An Alternative Assumption to Identify LATE in Regression Discontinuity Designs Yingying Dong University of California Irvine September 2014 Abstract One key assumption Imbens and Angrist (1994) use to
More informationRegression Discontinuity Designs with a Continuous Treatment
Regression Discontinuity Designs with a Continuous Treatment Yingying Dong, Ying-Ying Lee, Michael Gou First version: April 17; this version: December 18 Abstract This paper provides identification and
More informationDifferences-in-differences, differences of quantiles and quantiles of differences
Differences-in-differences, differences of quantiles and quantiles of differences Franco Peracchi October 13, 2006 1 A MOTIVATING EXAMPLE 1 A motivating example Economists have largely debated on the causes
More informationLecture 9: Quantile Methods 2
Lecture 9: Quantile Methods 2 1. Equivariance. 2. GMM for Quantiles. 3. Endogenous Models 4. Empirical Examples 1 1. Equivariance to Monotone Transformations. Theorem (Equivariance of Quantiles under Monotone
More informationAn Alternative Assumption to Identify LATE in Regression Discontinuity Design
An Alternative Assumption to Identify LATE in Regression Discontinuity Design Yingying Dong University of California Irvine May 2014 Abstract One key assumption Imbens and Angrist (1994) use to identify
More informationRegression Discontinuity Designs with a Continuous Treatment
Regression Discontinuity Designs with a Continuous Treatment Yingying Dong, Ying-Ying Lee, Michael Gou This version: March 18 Abstract This paper provides identification and inference theory for the class
More informationA Discontinuity Test for Identification in Nonparametric Models with Endogeneity
A Discontinuity Test for Identification in Nonparametric Models with Endogeneity Carolina Caetano 1 Christoph Rothe 2 Nese Yildiz 1 1 Department of Economics 2 Department of Economics University of Rochester
More informationSensitivity checks for the local average treatment effect
Sensitivity checks for the local average treatment effect Martin Huber March 13, 2014 University of St. Gallen, Dept. of Economics Abstract: The nonparametric identification of the local average treatment
More information150C Causal Inference
150C Causal Inference Instrumental Variables: Modern Perspective with Heterogeneous Treatment Effects Jonathan Mummolo May 22, 2017 Jonathan Mummolo 150C Causal Inference May 22, 2017 1 / 26 Two Views
More informationUnconditional Quantile Treatment Effects Under Endogeneity
Journal of Business & Economic Statistics ISSN: 0735-0015 (Print) 1537-2707 (Online) Journal homepage: http://amstat.tandfonline.com/loi/ubes20 Unconditional Quantile Treatment Effects Under Endogeneity
More informationJob Displacement of Older Workers during the Great Recession: Tight Bounds on Distributional Treatment Effect Parameters
Job Displacement of Older Workers during the Great Recession: Tight Bounds on Distributional Treatment Effect Parameters using Panel Data Brantly Callaway October 24, 205 Job Market Paper Abstract Older
More informationInstrumental Variables in Action: Sometimes You get What You Need
Instrumental Variables in Action: Sometimes You get What You Need Joshua D. Angrist MIT and NBER May 2011 Introduction Our Causal Framework A dummy causal variable of interest, i, is called a treatment,
More informationWhat s New in Econometrics? Lecture 14 Quantile Methods
What s New in Econometrics? Lecture 14 Quantile Methods Jeff Wooldridge NBER Summer Institute, 2007 1. Reminders About Means, Medians, and Quantiles 2. Some Useful Asymptotic Results 3. Quantile Regression
More informationRegression Discontinuity Designs with a Continuous Treatment
Regression Discontinuity Designs with a Continuous Treatment Yingying Dong, Ying-Ying Lee, Michael Gou This version: January 8 Abstract This paper provides identification and inference theory for the class
More informationSelection on Observables: Propensity Score Matching.
Selection on Observables: Propensity Score Matching. Department of Economics and Management Irene Brunetti ireneb@ec.unipi.it 24/10/2017 I. Brunetti Labour Economics in an European Perspective 24/10/2017
More informationA Course in Applied Econometrics. Lecture 2 Outline. Estimation of Average Treatment Effects. Under Unconfoundedness, Part II
A Course in Applied Econometrics Lecture Outline Estimation of Average Treatment Effects Under Unconfoundedness, Part II. Assessing Unconfoundedness (not testable). Overlap. Illustration based on Lalonde
More informationINFERENCE APPROACHES FOR INSTRUMENTAL VARIABLE QUANTILE REGRESSION. 1. Introduction
INFERENCE APPROACHES FOR INSTRUMENTAL VARIABLE QUANTILE REGRESSION VICTOR CHERNOZHUKOV CHRISTIAN HANSEN MICHAEL JANSSON Abstract. We consider asymptotic and finite-sample confidence bounds in instrumental
More informationUnconditional Quantile Regression with Endogenous Regressors
Unconditional Quantile Regression with Endogenous Regressors Pallab Kumar Ghosh Department of Economics Syracuse University. Email: paghosh@syr.edu Abstract This paper proposes an extension of the Fortin,
More informationExtrapoLATE-ing: External Validity and Overidentification in the LATE framework. March 2011
ExtrapoLATE-ing: External Validity and Overidentification in the LATE framework Josh Angrist MIT Iván Fernández-Val BU March 2011 Instrumental Variables and External Validity Local Average Treatment Effects
More informationNew Developments in Econometrics Lecture 16: Quantile Estimation
New Developments in Econometrics Lecture 16: Quantile Estimation Jeff Wooldridge Cemmap Lectures, UCL, June 2009 1. Review of Means, Medians, and Quantiles 2. Some Useful Asymptotic Results 3. Quantile
More informationQUANTILE MODELS WITH ENDOGENEITY
QUANTILE MODELS WITH ENDOGENEITY V. CHERNOZHUKOV AND C. HANSEN Abstract. In this article, we review quantile models with endogeneity. We focus on models that achieve identification through the use of instrumental
More informationEstimating the Dynamic Effects of a Job Training Program with M. Program with Multiple Alternatives
Estimating the Dynamic Effects of a Job Training Program with Multiple Alternatives Kai Liu 1, Antonio Dalla-Zuanna 2 1 University of Cambridge 2 Norwegian School of Economics June 19, 2018 Introduction
More informationA Course in Applied Econometrics. Lecture 5. Instrumental Variables with Treatment Effect. Heterogeneity: Local Average Treatment Effects.
A Course in Applied Econometrics Lecture 5 Outline. Introduction 2. Basics Instrumental Variables with Treatment Effect Heterogeneity: Local Average Treatment Effects 3. Local Average Treatment Effects
More informationInstrumental Variables in Action
Instrumental Variables in Action Remarks in honor of P.G. Wright s 150th birthday Joshua D. Angrist MIT and NBER October 2011 What is Econometrics Anyway? What s the difference between statistics and econometrics?
More informationAdditional Material for Estimating the Technology of Cognitive and Noncognitive Skill Formation (Cuttings from the Web Appendix)
Additional Material for Estimating the Technology of Cognitive and Noncognitive Skill Formation (Cuttings from the Web Appendix Flavio Cunha The University of Pennsylvania James Heckman The University
More informationWhat s New in Econometrics. Lecture 1
What s New in Econometrics Lecture 1 Estimation of Average Treatment Effects Under Unconfoundedness Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Potential Outcomes 3. Estimands and
More informationInstrumental Variables (Take 2): Causal Effects in a Heterogeneous World
Instrumental Variables (Take 2): Causal Effects in a Heterogeneous World Josh Angrist MIT 14.387 (Fall 2014) Our Constant-Effects Benchmark The traditional IV framework is the linear, constant-effects
More informationGenerated Covariates in Nonparametric Estimation: A Short Review.
Generated Covariates in Nonparametric Estimation: A Short Review. Enno Mammen, Christoph Rothe, and Melanie Schienle Abstract In many applications, covariates are not observed but have to be estimated
More informationProgram Evaluation with High-Dimensional Data
Program Evaluation with High-Dimensional Data Alexandre Belloni Duke Victor Chernozhukov MIT Iván Fernández-Val BU Christian Hansen Booth ESWC 215 August 17, 215 Introduction Goal is to perform inference
More informationData Models. Dalia A. Ghanem. May 8, Abstract. Recent work on nonparametric identification of average partial effects (APEs) from panel
Testing Identifying Assumptions in Nonseparable Panel Data Models Dalia A. Ghanem May 8, 2015 Abstract Recent work on nonparametric identification of average partial effects (APEs) from panel data require
More informationEfficient Semiparametric Estimation of Quantile Treatment Effects
fficient Semiparametric stimation of Quantile Treatment ffects Sergio Firpo U Berkeley - Department of conomics This Draft: January, 2003 Abstract This paper presents calculations of semiparametric efficiency
More informationOnline Appendix for Targeting Policies: Multiple Testing and Distributional Treatment Effects
Online Appendix for Targeting Policies: Multiple Testing and Distributional Treatment Effects Steven F Lehrer Queen s University, NYU Shanghai, and NBER R Vincent Pohl University of Georgia November 2016
More informationInstrumental Variables
Instrumental Variables Kosuke Imai Harvard University STAT186/GOV2002 CAUSAL INFERENCE Fall 2018 Kosuke Imai (Harvard) Noncompliance in Experiments Stat186/Gov2002 Fall 2018 1 / 18 Instrumental Variables
More informationPartial Identification of the Distribution of Treatment Effects
Partial Identification of the Distribution of Treatment Effects Brigham R. Frandsen Lars J. Lefgren October 5, 2016 Abstract This article develops bounds on the distribution of treatment effects under
More informationPotential Outcomes Model (POM)
Potential Outcomes Model (POM) Relationship Between Counterfactual States Causality Empirical Strategies in Labor Economics, Angrist Krueger (1999): The most challenging empirical questions in economics
More informationExact Nonparametric Inference for a Binary. Endogenous Regressor
Exact Nonparametric Inference for a Binary Endogenous Regressor Brigham R. Frandsen December 5, 2013 Abstract This paper describes a randomization-based estimation and inference procedure for the distribution
More informationIdenti cation of Positive Treatment E ects in. Randomized Experiments with Non-Compliance
Identi cation of Positive Treatment E ects in Randomized Experiments with Non-Compliance Aleksey Tetenov y February 18, 2012 Abstract I derive sharp nonparametric lower bounds on some parameters of the
More informationTESTING IDENTIFYING ASSUMPTIONS IN FUZZY REGRESSION DISCONTINUITY DESIGN 1. INTRODUCTION
TESTING IDENTIFYING ASSUMPTIONS IN FUZZY REGRESSION DISCONTINUITY DESIGN YOICHI ARAI a YU-CHIN HSU b TORU KITAGAWA c ISMAEL MOURIFIÉ d YUANYUAN WAN e GRIPS ACADEMIA SINICA UCL UNIVERSITY OF TORONTO ABSTRACT.
More informationA test of the conditional independence assumption in sample selection models
A test of the conditional independence assumption in sample selection models Martin Huber, Blaise Melly First draft: December 2006, Last changes: September 2012 Abstract: Identi cation in most sample selection
More informationBootstrapping Heteroskedasticity Consistent Covariance Matrix Estimator
Bootstrapping Heteroskedasticity Consistent Covariance Matrix Estimator by Emmanuel Flachaire Eurequa, University Paris I Panthéon-Sorbonne December 2001 Abstract Recent results of Cribari-Neto and Zarkos
More informationUniversity of Toronto Department of Economics. Testing Local Average Treatment Effect Assumptions
University of Toronto Department of Economics Working Paper 514 Testing Local Average Treatment Effect Assumptions By Ismael Mourifie and Yuanyuan Wan July 7, 214 TESTING LATE ASSUMPTIONS ISMAEL MOURIFIÉ
More informationUnconditional Quantile Regression for Panel Data with Exogenous or Endogenous Regressors
Unconditional Quantile Regression for Panel Data with Exogenous or Endogenous Regressors David Powell RAND February 29, 2012 Abstract Unconditional quantile treatment effects are difficult to estimate
More informationEstimation and Inference for Distribution Functions and Quantile Functions in Endogenous Treatment Effect Models. Abstract
Estimation and Inference for Distribution Functions and Quantile Functions in Endogenous Treatment Effect Models Yu-Chin Hsu Robert P. Lieli Tsung-Chih Lai Abstract We propose a new monotonizing method
More informationSupplemental Appendix to "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs"
Supplemental Appendix to "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs" Yingying Dong University of California Irvine February 2018 Abstract This document provides
More informationIV Quantile Regression for Group-level Treatments, with an Application to the Distributional Effects of Trade
IV Quantile Regression for Group-level Treatments, with an Application to the Distributional Effects of Trade Denis Chetverikov Brad Larsen Christopher Palmer UCLA, Stanford and NBER, UC Berkeley September
More informationPrinciples Underlying Evaluation Estimators
The Principles Underlying Evaluation Estimators James J. University of Chicago Econ 350, Winter 2019 The Basic Principles Underlying the Identification of the Main Econometric Evaluation Estimators Two
More informationCausal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies
Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies Kosuke Imai Department of Politics Princeton University November 13, 2013 So far, we have essentially assumed
More informationCasuality and Programme Evaluation
Casuality and Programme Evaluation Lecture V: Difference-in-Differences II Dr Martin Karlsson University of Duisburg-Essen Summer Semester 2017 M Karlsson (University of Duisburg-Essen) Casuality and Programme
More informationFour Parameters of Interest in the Evaluation. of Social Programs. James J. Heckman Justin L. Tobias Edward Vytlacil
Four Parameters of Interest in the Evaluation of Social Programs James J. Heckman Justin L. Tobias Edward Vytlacil Nueld College, Oxford, August, 2005 1 1 Introduction This paper uses a latent variable
More informationInference on Optimal Treatment Assignments
Inference on Optimal Treatment Assignments Timothy B. Armstrong Yale University Shu Shen University of California, Davis April 8, 2015 Abstract We consider inference on optimal treatment assignments. Our
More informationNonadditive Models with Endogenous Regressors
Nonadditive Models with Endogenous Regressors Guido W. Imbens First Draft: July 2005 This Draft: February 2006 Abstract In the last fifteen years there has been much work on nonparametric identification
More informationChapter 8. Quantile Regression and Quantile Treatment Effects
Chapter 8. Quantile Regression and Quantile Treatment Effects By Joan Llull Quantitative & Statistical Methods II Barcelona GSE. Winter 2018 I. Introduction A. Motivation As in most of the economics literature,
More informationIdentifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models
Identifying the Effect of Changing the Policy Threshold in Regression Discontinuity Models Yingying Dong and Arthur Lewbel University of California Irvine and Boston College First version July 2010, revised
More informationFixed Effects, Invariance, and Spatial Variation in Intergenerational Mobility
American Economic Review: Papers & Proceedings 2016, 106(5): 400 404 http://dx.doi.org/10.1257/aer.p20161082 Fixed Effects, Invariance, and Spatial Variation in Intergenerational Mobility By Gary Chamberlain*
More informationJob Training Partnership Act (JTPA)
Causal inference Part I.b: randomized experiments, matching and regression (this lecture starts with other slides on randomized experiments) Frank Venmans Example of a randomized experiment: Job Training
More informationAGEC 661 Note Fourteen
AGEC 661 Note Fourteen Ximing Wu 1 Selection bias 1.1 Heckman s two-step model Consider the model in Heckman (1979) Y i = X iβ + ε i, D i = I {Z iγ + η i > 0}. For a random sample from the population,
More informationChilean and High School Dropout Calculations to Testing the Correlated Random Coefficient Model
Chilean and High School Dropout Calculations to Testing the Correlated Random Coefficient Model James J. Heckman University of Chicago, University College Dublin Cowles Foundation, Yale University and
More informationComparative Advantage and Schooling
Comparative Advantage and Schooling Pedro Carneiro University College London, Institute for Fiscal Studies and IZA Sokbae Lee University College London and Institute for Fiscal Studies June 7, 2004 Abstract
More informationNonparametric Tests for Treatment Effect Heterogeneity
DISCUSSION PAPER SERIES IZA DP No. 2091 Nonparametric Tests for Treatment Effect Heterogeneity Richard K. Crump V. Joseph Hotz Guido W. Imbens Oscar A. Mitnik April 2006 Forschungsinstitut zur Zukunft
More informationGov 2002: 9. Differences in Differences
Gov 2002: 9. Differences in Differences Matthew Blackwell October 30, 2015 1 / 40 1. Basic differences-in-differences model 2. Conditional DID 3. Standard error issues 4. Other DID approaches 2 / 40 Where
More informationSensitivity to Missing Data Assumptions: Theory and An Evaluation of the U.S. Wage Structure. September 21, 2012
Sensitivity to Missing Data Assumptions: Theory and An Evaluation of the U.S. Wage Structure Andres Santos UC San Diego September 21, 2012 The Problem Missing data is ubiquitous in modern economic research
More informationReview of probability and statistics 1 / 31
Review of probability and statistics 1 / 31 2 / 31 Why? This chapter follows Stock and Watson (all graphs are from Stock and Watson). You may as well refer to the appendix in Wooldridge or any other introduction
More informationRon Heck, Fall Week 3: Notes Building a Two-Level Model
Ron Heck, Fall 2011 1 EDEP 768E: Seminar on Multilevel Modeling rev. 9/6/2011@11:27pm Week 3: Notes Building a Two-Level Model We will build a model to explain student math achievement using student-level
More informationComparing Distributional Policy Parameters between Populations with Different Outcome Structures
Comparing Distributional Policy Parameters between Populations with Different Outcome Structures Anthony Strittmatter September 2014 Discussion Paper no. 2014-29 School of Economics and Political Science,
More informationBounds on Average and Quantile Treatment Effects of Job Corps Training on Wages*
Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages* German Blanco Department of Economics, State University of New York at Binghamton gblanco1@binghamton.edu Carlos A. Flores
More informationWORKING P A P E R. Unconditional Quantile Regression for Panel Data with Exogenous or Endogenous Regressors DAVID POWELL WR
WORKING P A P E R Unconditional Quantile Regression for Panel Data with Exogenous or Endogenous Regressors DAVID POWELL WR-710-1 November 2010 This paper series made possible by the NIA funded RAND Center
More informationted: a Stata Command for Testing Stability of Regression Discontinuity Models
ted: a Stata Command for Testing Stability of Regression Discontinuity Models Giovanni Cerulli IRCrES, Research Institute on Sustainable Economic Growth National Research Council of Italy 2016 Stata Conference
More informationECON Introductory Econometrics. Lecture 17: Experiments
ECON4150 - Introductory Econometrics Lecture 17: Experiments Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 13 Lecture outline 2 Why study experiments? The potential outcome framework.
More informationTesting for Treatment Effect Heterogeneity in Regression Discontinuity Design
Testing for Treatment Effect Heterogeneity in Regression Discontinuity Design Yu-Chin Hsu Institute of Economics Academia Sinica Shu Shen Department of Economics University of California, Davis E-mail:
More informationLecture 28 Chi-Square Analysis
Lecture 28 STAT 225 Introduction to Probability Models April 23, 2014 Whitney Huang Purdue University 28.1 χ 2 test for For a given contingency table, we want to test if two have a relationship or not
More informationSelection endogenous dummy ordered probit, and selection endogenous dummy dynamic ordered probit models
Selection endogenous dummy ordered probit, and selection endogenous dummy dynamic ordered probit models Massimiliano Bratti & Alfonso Miranda In many fields of applied work researchers need to model an
More informationConsistent Tests for Conditional Treatment Effects
Consistent Tests for Conditional Treatment Effects Yu-Chin Hsu Department of Economics University of Missouri at Columbia Preliminary: please do not cite or quote without permission.) This version: May
More informationApproximate Distributions of the Likelihood Ratio Statistic in a Structural Equation with Many Instruments
CIRJE-F-466 Approximate Distributions of the Likelihood Ratio Statistic in a Structural Equation with Many Instruments Yukitoshi Matsushita CIRJE, Faculty of Economics, University of Tokyo February 2007
More informationLecture 8 Inequality Testing and Moment Inequality Models
Lecture 8 Inequality Testing and Moment Inequality Models Inequality Testing In the previous lecture, we discussed how to test the nonlinear hypothesis H 0 : h(θ 0 ) 0 when the sample information comes
More informationThe changes-in-changes model with covariates
The changes-in-changes model with covariates Blaise Melly, Giulia Santangelo Bern University, European Commission - JRC First version: January 2015 Last changes: January 23, 2015 Preliminary! Abstract:
More informationBy Marcel Voia. February Abstract
Nonlinear DID estimation of the treatment effect when the outcome variable is the employment/unemployment duration By Marcel Voia February 2005 Abstract This paper uses an econometric framework introduced
More informationTesting instrument validity for LATE identification based on inequality moment constraints
Testing instrument validity for LATE identification based on inequality moment constraints Martin Huber* and Giovanni Mellace** *Harvard University, Dept. of Economics and University of St. Gallen, Dept.
More informationNonparametric Tests for Treatment Effect. Heterogeneity
forthcoming in The Review of Economics and Statistics Nonparametric Tests for Treatment Effect Heterogeneity Richard K. Crump V. Joseph Hotz Guido W. Imbens Oscar A. Mitnik First Draft: November 2005 Final
More informationNonparametric Tests for Treatment Effect Heterogeneity
Nonparametric Tests for Treatment Effect Heterogeneity The Harvard community has made this article openly available. Please share how this access benefits you. Your story matters. Citation Published Version
More informationECON 482 / WH Hong Binary or Dummy Variables 1. Qualitative Information
1. Qualitative Information Qualitative Information Up to now, we assume that all the variables has quantitative meaning. But often in empirical work, we must incorporate qualitative factor into regression
More informationWhat s New in Econometrics. Lecture 13
What s New in Econometrics Lecture 13 Weak Instruments and Many Instruments Guido Imbens NBER Summer Institute, 2007 Outline 1. Introduction 2. Motivation 3. Weak Instruments 4. Many Weak) Instruments
More informationCALIFORNIA INSTITUTE OF TECHNOLOGY
DIVISION OF THE HUMANITIES AND SOCIAL SCIENCES CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125 IDENTIFYING TREATMENT EFFECTS UNDER DATA COMBINATION Yanqin Fan University of Washington Robert
More informationMichael Lechner Causal Analysis RDD 2014 page 1. Lecture 7. The Regression Discontinuity Design. RDD fuzzy and sharp
page 1 Lecture 7 The Regression Discontinuity Design fuzzy and sharp page 2 Regression Discontinuity Design () Introduction (1) The design is a quasi-experimental design with the defining characteristic
More informationTesting for covariate balance using quantile regression and resampling methods
Testing for covariate balance using quantile regression and resampling methods Martin Huber June 2010 Discussion Paper no. 2010-18 Department of Economics University of St. Gallen Editor: Publisher: Electronic
More informationAnswers to Problem Set #4
Answers to Problem Set #4 Problems. Suppose that, from a sample of 63 observations, the least squares estimates and the corresponding estimated variance covariance matrix are given by: bβ bβ 2 bβ 3 = 2
More informationNonparametric Instrumental Variables Identification and Estimation of Nonseparable Panel Models
Nonparametric Instrumental Variables Identification and Estimation of Nonseparable Panel Models Bradley Setzler December 8, 2016 Abstract This paper considers identification and estimation of ceteris paribus
More informationEcon 2148, fall 2017 Instrumental variables II, continuous treatment
Econ 2148, fall 2017 Instrumental variables II, continuous treatment Maximilian Kasy Department of Economics, Harvard University 1 / 35 Recall instrumental variables part I Origins of instrumental variables:
More informationChapter 2: Fundamentals of Statistics Lecture 15: Models and statistics
Chapter 2: Fundamentals of Statistics Lecture 15: Models and statistics Data from one or a series of random experiments are collected. Planning experiments and collecting data (not discussed here). Analysis:
More information