Bounding the Labor Supply Responses to a Randomized Welfare Experiment: A Revealed Preference Approach

Similar documents
The Incentives Created by the Tax-Benefit System Facing Low-Income Families in Georgia

1 Static (one period) model

Bounds on Elasticities with Optimization Frictions: A Synthesis of Micro and Macro Evidence on Labor Supply

Economics 2450A: Public Economics Section 8: Optimal Minimum Wage and Introduction to Capital Taxation

Estimating the Dynamic Effects of a Job Training Program with M. Program with Multiple Alternatives

A Note on the Welfare Evaluation of Tax Reform with Non-Convex Preferences and Discrete Labor Supply

Labour Supply Responses and the Extensive Margin: The US, UK and France

Empirical approaches in public economics

What s New in Econometrics. Lecture 1

Optimal Income Taxation with Unemployment and Wage Responses: A Sufficient Statistics Approach

Testing for Rank Invariance or Similarity in Program Evaluation: The Effect of Training on Earnings Revisited

Principles Underlying Evaluation Estimators

Florian Hoffmann. September - December Vancouver School of Economics University of British Columbia

Sensitivity checks for the local average treatment effect

Identification with Latent Choice Sets: The Case of the Head Start Impact Study

Income Distribution Dynamics with Endogenous Fertility. By Michael Kremer and Daniel Chen

Impact Evaluation Technical Workshop:

Flexible Estimation of Treatment Effect Parameters

(e.g., Blundell and Powell (2003); Chesher (2003); Altonji and Matzkin (2005); Florens et al. (2009); Imbens

Online Appendix The Growth of Low Skill Service Jobs and the Polarization of the U.S. Labor Market. By David H. Autor and David Dorn

Combining Non-probability and Probability Survey Samples Through Mass Imputation

More on Roy Model of Self-Selection

231,312 SSI TOTAL 19,843 34,831 55,765 10,010 72, ,066 57, ,148 98,103 61, ,801 ELD. & DISAB. W M

232,701 SSI TOTAL 19,474 34,520 55,384 9,972 71, ,610 57, ,173 99,130 62, ,745 ELD. & DISAB. W M

232,707 SSI TOTAL 19,424 34,236 55,157 9,884 71, ,047 58, ,281 99,162 62, ,340 ELD. & DISAB. W M

233,975 SSI TOTAL 19,433 33,949 55,018 9,882 71, ,842 58, ,799 99,943 62, ,299 ELD. & DISAB. W M

Optimal Income, Education and Bequest Taxes in an Intergenerational Model

CS229 Machine Learning Project: Allocating funds to the right people

Regression Discontinuity Designs.

Recitation Notes 6. Konrad Menzel. October 22, 2006

Optimal age-dependent income taxation in a dynamic extensive model: The case for negative participation tax to the young people

1. Basic Model of Labor Supply

227,261 SSI TOTAL 19,918 35,005 55,857 10,196 72, ,825 56, ,752 96,085 61, ,448 ELD. & DISAB. W M

229,737 SSI TOTAL 20,091 35,056 55,864 10,132 72, ,680 56, ,432 96,967 61, ,264 ELD. & DISAB. W M

223,965 SSI TOTAL 20,371 35,504 56,101 10,364 72, ,667 55, ,380 94,913 61, ,288 ELD. & DISAB. W M

Rising Wage Inequality and the Effectiveness of Tuition Subsidy Policies:

ECOM 009 Macroeconomics B. Lecture 2

Parametric and Non-Parametric Weighting Methods for Mediation Analysis: An Application to the National Evaluation of Welfare-to-Work Strategies

The Econometric Evaluation of Policy Design: Part I: Heterogeneity in Program Impacts, Modeling Self-Selection, and Parameters of Interest

Optimal Mirrleesian Income Taxation with Tax Avoidance

Selection on Observables: Propensity Score Matching.

A Course in Applied Econometrics. Lecture 2 Outline. Estimation of Average Treatment Effects. Under Unconfoundedness, Part II

Applied Microeconometrics. Maximilian Kasy

Groupe de lecture. Instrumental Variables Estimates of the Effect of Subsidized Training on the Quantiles of Trainee Earnings. Abadie, Angrist, Imbens

POVERTY. Questionnaire. Q1a. What is your feeling about how things are going with the economy in the U.S.? Overall, would you say the economy is:

Optimal Insurance of Search Risk

Chilean and High School Dropout Calculations to Testing the Correlated Random Coefficient Model

Just a Few Keystrokes Away

leebounds: Lee s (2009) treatment effects bounds for non-random sample selection for Stata

ECOM 009 Macroeconomics B. Lecture 3

Differences-in-differences, differences of quantiles and quantiles of differences

Ratio-of-Mediator-Probability Weighting for Causal Mediation Analysis. in the Presence of Treatment-by-Mediator Interaction

Additional Material for Estimating the Technology of Cognitive and Noncognitive Skill Formation (Cuttings from the Web Appendix)

Optimal Income Taxation: Mirrlees Meets Ramsey

Online Appendix for Targeting Policies: Multiple Testing and Distributional Treatment Effects

Supplemental Appendix to "Alternative Assumptions to Identify LATE in Fuzzy Regression Discontinuity Designs"

Proofs and derivations

Finding Instrumental Variables: Identification Strategies. Amine Ouazad Ass. Professor of Economics

Econometric Causality

The World Bank Decentralized Community Driven Services Project (P117764)

Notes on Heterogeneity, Aggregation, and Market Wage Functions: An Empirical Model of Self-Selection in the Labor Market

u(c t, x t+1 ) = c α t + x α t+1

By Marcel Voia. February Abstract

THE SURVEY OF INCOME AND PROGRAM PARTICIPATION

Optimal Insurance of Search Risk

Economics 250a Lecture 2

Econometrics Homework 4 Solutions

5.März 2015 T. Bolli J.Kemper

GROWING APART: THE CHANGING FIRM-SIZE WAGE PREMIUM AND ITS INEQUALITY CONSEQUENCES ONLINE APPENDIX

How Revealing is Revealed Preference?

Imbens/Wooldridge, IRP Lecture Notes 2, August 08 1

An Introduction to Causal Mediation Analysis. Xu Qin University of Chicago Presented at the Central Iowa R User Group Meetup Aug 10, 2016

In the Ramsey model we maximized the utility U = u[c(t)]e nt e t dt. Now

An Alternative Assumption to Identify LATE in Regression Discontinuity Designs

CEPA Working Paper No

Job Displacement of Older Workers during the Great Recession: Tight Bounds on Distributional Treatment Effect Parameters

Lecture 1: Labour Economics and Wage-Setting Theory

Chapter 60 Evaluating Social Programs with Endogenous Program Placement and Selection of the Treated

ted: a Stata Command for Testing Stability of Regression Discontinuity Models

Estimating Dynamic Treatment Effects in Event Studies with Heterogeneous Treatment Effects

Causal Inference Lecture Notes: Causal Inference with Repeated Measures in Observational Studies

Economic Growth: Lecture 8, Overlapping Generations

Collective Model with Children: Public Good and Household Production

Chapter 1 Introduction. What are longitudinal and panel data? Benefits and drawbacks of longitudinal data Longitudinal data models Historical notes

Item Response Theory for Conjoint Survey Experiments

Marriage Institutions and Sibling Competition: Online Theory Appendix

A dynamic perspective to evaluate multiple treatments through a causal latent Markov model

1 Web Appendix: Equilibrium outcome under collusion (multiple types-multiple contracts)

Incentives and Nutrition for Rotten Kids: Intrahousehold Food Allocation in the Philippines

Neoclassical Business Cycle Model

Statistical Models for Causal Analysis

The World Bank CG Rep. LISUNGI Safety Nets System Project (P145263)

Quantitative Economics for the Evaluation of the European Policy

Welfare Comparisons, Economies of Scale and Indifference Scale in Time Use

Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages*

Market and Nonmarket Benefits

Impatience vs. Incentives

Selection endogenous dummy ordered probit, and selection endogenous dummy dynamic ordered probit models

Trade, Inequality and Costly Redistribution

Columbia University. Department of Economics Discussion Paper Series. Does Fertility Respond to Financial Incentives? Guy Laroque Bernard Salanié

Transcription:

Kline Bounding Labor Supply Responses Bounding the Labor Supply Responses to a Randomized Welfare Experiment: A Revealed Preference Approach Patrick Kline UC Berkeley Melissa Tartari University of Chicago October 2015

Motivation Optimal design of assistance policies depends on magnitude of extensive (work/not work) and intensive (how much to earn conditional on working) margin responsiveness (Diamond, 1980; Saez, 2002; Laroque, 2005) Conventional wisdom: most adjustment occurs on extensive margin. But... how exactly do we know size of intensive margin responses? Mean effects (e.g. Eissa and Liebman, 1996; Meyer and Rosenbaum, 2001). Bunching at kink points (e.g. Saez, 2010). However: Mean effects not enough since most policies (e.g. EITC, TANF) incentivize some agents to work more and some to work less (Bitler, Gelbach, and Hoynes, 2006) Issues in interpretation of excess mass at kinks if agents lack fine control (Chetty et al., 2011) Need to infer distribution of responses to policy. A nontrivial task, even with experimental data (Heckman, Smith, and Clements, 1997)

Motivation Optimal design of assistance policies depends on magnitude of extensive (work/not work) and intensive (how much to earn conditional on working) margin responsiveness (Diamond, 1980; Saez, 2002; Laroque, 2005) Conventional wisdom: most adjustment occurs on extensive margin. But... how exactly do we know size of intensive margin responses? Mean effects (e.g. Eissa and Liebman, 1996; Meyer and Rosenbaum, 2001). Bunching at kink points (e.g. Saez, 2010). However: Mean effects not enough since most policies (e.g. EITC, TANF) incentivize some agents to work more and some to work less (Bitler, Gelbach, and Hoynes, 2006) Issues in interpretation of excess mass at kinks if agents lack fine control (Chetty et al., 2011) Need to infer distribution of responses to policy. A nontrivial task, even with experimental data (Heckman, Smith, and Clements, 1997)

Motivation Optimal design of assistance policies depends on magnitude of extensive (work/not work) and intensive (how much to earn conditional on working) margin responsiveness (Diamond, 1980; Saez, 2002; Laroque, 2005) Conventional wisdom: most adjustment occurs on extensive margin. But... how exactly do we know size of intensive margin responses? Mean effects (e.g. Eissa and Liebman, 1996; Meyer and Rosenbaum, 2001). Bunching at kink points (e.g. Saez, 2010). However: Mean effects not enough since most policies (e.g. EITC, TANF) incentivize some agents to work more and some to work less (Bitler, Gelbach, and Hoynes, 2006) Issues in interpretation of excess mass at kinks if agents lack fine control (Chetty et al., 2011) Need to infer distribution of responses to policy. A nontrivial task, even with experimental data (Heckman, Smith, and Clements, 1997)

Motivation Optimal design of assistance policies depends on magnitude of extensive (work/not work) and intensive (how much to earn conditional on working) margin responsiveness (Diamond, 1980; Saez, 2002; Laroque, 2005) Conventional wisdom: most adjustment occurs on extensive margin. But... how exactly do we know size of intensive margin responses? Mean effects (e.g. Eissa and Liebman, 1996; Meyer and Rosenbaum, 2001). Bunching at kink points (e.g. Saez, 2010). However: Mean effects not enough since most policies (e.g. EITC, TANF) incentivize some agents to work more and some to work less (Bitler, Gelbach, and Hoynes, 2006) Issues in interpretation of excess mass at kinks if agents lack fine control (Chetty et al., 2011) Need to infer distribution of responses to policy. A nontrivial task, even with experimental data (Heckman, Smith, and Clements, 1997)

A Hypothetical Reform density density Policy A Policy B Earnings Earnings

A Hypothetical Reform density density Policy A Policy B Earnings Earnings

Jobs First and BGH (2006) Study experimental data from Connecticut s Jobs First (JF) program which provided strong work incentives but generated a large eligibility notch in budget set at federal poverty line. Notch generated strong incentives to lower earnings in order to opt-in to welfare (Ashenfelter, 1983) Bitler, Gelbach, and Hoynes (BGH, 2006) provide nonparametric evidence suggestive of intensive margin response to welfare reform. They find that welfare reform: yielded a mean earnings effect near zero boosted the middle quantiles of earnings and lowered the top quantiles

BGH (2006)

This paper Exploit revealed preference restrictions to formally estimate frequency of intensive and extensive margin responses to Jobs First (JF) experiment Build non-parametric model of labor supply and program participation Allow: unrestricted heterogeneity / labor supply constraints / under-reporting decisions Derive allowable responses to reform via RP arguments ala Manski (2014) Exploit restrictions to derive bounds on probabilities of responding along various margins Results: Substantial intensive and extensive margin responses to JF reform Important under-reporting responses

Jobs First: Genesis and Experimental Design In 1996, U.S. states required to replace AFDC (Aid to Families with Dependent Children) with TANF (Temporary Assistance to Needy Families): time limits work requirements improved financial incentives to work CT implemented its own version of TANF: the Jobs First (JF) program In January 1996 and February 1997, MDRC conducted a randomized evaluation of JF. A baseline sample of 4,800 single parents: 50% randomly assigned to JF rules and 50% to the old AFDC rules Data: Baseline survey + administrative data on earnings and welfare participation before/after random assignment (RA)

Income vs Earnings for a Woman with 2 Children FPL+G AU size 3 in 1997: Earnings + Assistance Income G Slope 1 Slope 0.27 G = $543 FPL = $1,111 G/0.73+$90 = $835 FPL+G = $1,654 Off Welfare AFDC JF Slope 1 90 G/0.73 FPL +90 FPL+G Earnings

Food Stamps, EITC, and Payroll Taxes Figure 2: Net Income under Status Quo and Jobs First Policies, Accounting for Food Stamps and Taxes Net Income 45 degree line Off Welfare and FS On FS On Welfare (JF) 543 315 On Welfare + FS (JF) On Welfare (AFDC) On Welfare + FS (AFDC) 90 762 835 994 1111 1167 1444 2441 Gross Earnings

Non-financial Incentives of JF Time limits: Following BGH, restrict analysis to the first 7 Qs of the experiment: no woman is in danger of reaching the limit BGH find no evidence of anticipatory behavior over this horizon A test of our own along the lines of Grogger and Michaelopolous (2003) also fails to find anticipatory behavior Test Bloom et al. (2002): Time limits not strictly enforced (women knew this) Many families either exempt or granted an extension Work requirements and sanctions: Mandatory job search program led to increased welfare hassle

Data MDRC s Jobs First Public Use Files. Baseline survey merged with administrative information on: Welfare participation and payments, Earnings covered by the UI system. Data limitations: Monthly welfare payments are rounded (nearest $50). Earnings are rounded (nearest $100) and only available quarterly. The administrative measure of the AU size is missing for most cases. The number of children at the time of RA (kidcount) is top-coded at 3. Infer AU size from grant amount

Baseline Covariate Balance Table 2: Mean Sample Characteristics Overall Sample Jobs First AFDC Difference Difference (adjusted) Demographic Characteristics White 0.374 0.360 0.014 0.001 Black 0.380 0.384 0.004 0.000 Hispanic 0.214 0.224 0.010 0.001 Never married 0.654 0.661 0.007 0.000 Div/wid/sep/living apart 0.332 0.327 0.005 0.000 HS dropout 0.350 0.334 0.017 0.000 HS diploma/ged 0.583 0.604 0.021 0.000 More than HS diploma 0.066 0.062 0.004 0.000 More than 2 Children 0.235 0.214 0.021 0.000 Mother younger than 25 0.287 0.298 0.011 0.003 Mother age 25 34 0.412 0.414 0.003 0.005 Mother older than 34 0.301 0.287 0.014 0.002 Average quarterly pretreatment values Earnings 673 750 76* 4 [1306] [1379] (40) (6) Cash welfare 903 845 58** 1 [805] [784] (23) (2) Food stamps 356 344 12 0 [320] [304] (9) (1) Fraction of pretreatment quarters with Any earnings 0.319 0.347 0.029*** 0.000 [0.362] [0.370] (0.011) (0.001) Any cash welfare 0.581 0.551 0.030* 0.001 [0.451] [0.450] (0.013) (0.001) Any food stamps 0.613 0.605 0.008 0.000 [0.437] [0.431] (0.012) (0.001) # of cases 2,318 2,324

A Test for Intensive Margin Responsiveness If only effect of JF is to induce people to work, then program just shifts mass from zero to positive earnings levels. Therefore earnings distribution of JF group should First Order Stochastically Dominate (FOSD) distribution of AFDC group. Test using variant of Barrett and Donald (2003) procedure. Split by earnings 7Q prior to RA since work disincentives strongest among women likely to earn high amounts under AFDC. Expect FOSD violations among relatively high earning group.

Distributional Impacts Figure 4: EDFs of Quarterly Earnings Relative to 3 x Federal Poverty Line a) Unconditional.5.6.7.8.9 1 p value for equality: 0.000 p value for FOSD: 0.343 0.5 1 1.5 2 2.5 Quarterly Earnings as a fraction of 3*FPL. AFDC JF b) Zero Earnings Prior to Random Assignment c) Positive Earnings Prior to Random Assignment.6.7.8.9 1 p value for equality: 0.000 p value for FOSD: 0.986.2.4.6.8 1 p value for equality: 0.090 p value for FOSD: 0.039 0.5 1 1.5 2 2.5 Quarterly Earnings as a fraction of 3*FPL. 0.5 1 1.5 2 2.5 Quarterly Earnings as a fraction of 3*FPL. AFDC JF AFDC JF

A Closer Look at the JF Earnings Distribution Figure 3: Distribution of Quarterly Earnings Centered at 3 x Monthly Federal Poverty Line a) Unconditional No Bunching Frequency 0 100 200 300 400 500-1000 -500 0 500 1000 b) On Assistance all 3 Months of the Quarter c) Off Assistance all 3 Months of the Quarter Frequency 0 100 200 300 400 500 Ineligible Earnings Levels Frequency 0 50 100 150-1000 -500 0 500 1000-1000 -500 0 500 1000

Summary Rejection of FOSD intensive margin responses are present But how frequent? And of what nature? Absence of mass point at notch problematic for many frictionless models with non-zero intensive margin elasticity (e.g., Saez, 2010; Kleven and Waseem, 2013) Prudent to allow constraints on choice of earnings (Altonji and Paxson, 1988; Chetty et al., 2011; Dickens and Lundberg, 1993) Women with earnings above poverty line receiving assistance suggests under-reporting is prevalent Direct evidence of under-reporting in JF final report (Bloom et al., 2002) And in many related studies (Greenberg, Moffitt, and Friedman, 1981; Greenberg and Halsey, 1983; Hotz, Mullin, and Scholz, 2003)

A Warmup Model Conventional static utility maximization framework w/ no hours constraints Woman i has utility over hours (H) and a consumption equivalent (C) given by: U i ( H, + C ) Assume fixed wage rate W i, so that earnings are E = W i H Policy rules summarized by G t i (E) which gives transfer income under policy regime t {a,j} (AFDC or JF).

Model (cont.) Let D = 1 if the woman participates in welfare and zero otherwise C is earnings + transfer income net of stigma (φ i ), hassle costs (η i ), and fixed costs of work (µ i ): C = W i H µ i 1[H > 0] + D ( Gi t (W i H) φ i ηi t 1[H = 0] ) JF has greater hassle ( work first ) η j i η a i Woman i s optimization problem: max U i(h,c) H 0,D {0,1}

Model (cont.) Model constrains how woman i s choice under AFDC may be paired with choices under JF Restrictions follow from revealed preference arguments. The JF reform: made working on welfare more attractive potentially made not working on welfare less attractive had no impact on the appeal of other choices (e.g. working off welfare) Since U i (.,.) invariant to the regime, woman i will not be induced to: choose an option made less attractive by reform abandon an option made more attractive by it Restrictions illustrated graphically by considering the choices she can make under JF given her choice under AFDC

A Budget Set Earnings + Assistance Income FPL+G E AU size 3 in 1997: D G = $543 FPL = $1,111 G/0.73+$90 = $835 FPL+G = $1,654 Slope 1 C B A G Slope 0.27 B Off Welfare AFDC JF Slope 1 A 90 G/0.73 FPL +90 FPL+G Earnings

If she wouldn t work under AFDC FPL+G Earnings + Assistance Income G A Off Welfare AFDC JF A 90 G/0.73 FPL +90 FPL+G Earnings

Earnings + Assistance Income If she would work at low earnings levels FPL+G G B B C Off Welfare AFDC JF 90 G/0.73 FPL +90 FPL+G Earnings

Earnings + Assistance Income If she would work at high earnings levels FPL+G E D G Off Welfare AFDC JF 90 G/0.73 FPL +90 FPL+G Earnings

Allowed responses E FPL+G Earnings + Assistance Income G A B B C D Off Welfare AFDC JF TANF A 90 G/0.73 FPL +90 FPL+G Earnings

Disallowed responses E FPL+G Earnings + Assistance Income G A B B C D Off Welfare AFDC JF TANF A 90 G/0.73 FPL +90 FPL+G Earnings

Adding reporting decisions and constraints Woman i draws a set of offers Θ i {( Wi k,hi k )} Ki k=1. Can choose an offer (W,H) Θ i or not work (0,0). Nests unconstrained model as K i Transfer income is G t (E r ) where E r is amont reported to welfare agency Pay a cost κ i when under-reporting Consumption equivalent becomes: C = WH µ i 1[H > 0] + D ( G t (E r ) φ i η t i 1[E r = 0] κ i 1[E r < WH] ) Optimization problem is: max U (W,H) {Θ i,(0,0)},d {0,1},E r i (H,C) [0,WH]

Consumption Equivalent Budget w/ under-reporting options (K i = ) FPL+G G-φ-η a G-φ-η j Slope 1 Off Welfare AFDC JF Under-report G-φ-μ Slope 0.27 G-φ-μ-κ 90 Slope 1 G/0.73 FPL +90 FPL+G Earnings -μ

Consumption Equivalent Truthful reporting response FPL+G Indifference Curve B A G-φ-η a G-φ-η j Slope 1 Off Welfare AFDC JF Under-report G-φ-μ Slope 0.27 G-φ-μ-κ 90 Slope 1 G/0.73 FPL +90 FPL+G Earnings -μ

Consumption Equivalent Hassled into under-reporting FPL+G Indifference Curve B G-φ-η a G-φ-η j A Slope 1 Off Welfare AFDC JF Under-report G-φ-μ G-φ-μ-κ Slope 0.27 90 Slope 1 G/0.73 FPL +90 FPL+G Earnings -μ

Fully non-parametric model Dispense with consumption equivalent representation and define non-separable utility function: where: U t i (H,C,D,Z,R), C = WH + DG t i (E r ) (earnings + transfers) Z = D1[E r = 0] (zero reported earnings indicator) R = D1[E r < E] (under-reporting indicator) Optimization problem is: max (W,H) {Θ i,(0,0)},d {0,1},E r [0,WH] Ut i (H,C,D,Z,R)

Non-parametric restrictions on utility A.1 utility is strictly increasing in C A.2 Ui t (H,C,1,Z,1) < Ui t (H,C,1,Z,0) (under-reporting is costly) A.3 Ui t (H,C,1,1,R) Ui t (H,C,1,0,R) (hassle costs may exist) A.4 U j i (H,C,1,1,R) Ua i (H,C,1,1,R) (JF hassle AFDC hassle) A.5 U j i (H,C,1,0,R) = Ua i (H,C,1,0,R) (regime-invariance #1) A.6 U j i (H,C,0,0,0) = Ua i (H,C,0,0,0) (regime-invariance #2) A.5+A.6 imply: Under-reporting costs and stigma are regime-invariant Value of off-welfare alternatives are regime-invariant

Graphical example: quasi-linear utility Useful to consider special case obeying A.1-A.6: U t i (H,C,D,Z,R) = v i (C) α i H D ( φ i + η t i 1[E r = 0] + κ i 1[E r < WH] ) In what follows, suppose: v i (.) concave η j i > η a i = 0 (hassled only under JF)

Choices (and payoffs) under AFDC with one offer Earnings + Assistance Income v G v 0 FPL+G G 1 1 E G H 1 a 1 1 E G E H v v 1 1 E H v Off Welfare On Welfare under AFDC On Welfare under JF On Welfare under reporting Available allocation Optimal allocation 1 90 E G/0.73 FPL +90 FPL+G Earnings

Hassled off welfare into working below FPL Earnings + Assistance Income G j G v v v 0 FPL+G G 1 1 E G H v 1 1 E G H 1 a 1 1 E G E H v v 1 1 E H v Off Welfare On Welfare under AFDC On Welfare under JF On Welfare under reporting Available allocation Optimal allocation 1 90 E G/0.73 FPL +90 FPL+G Earnings

Empirical content Primitives governing choices: ( ) θ i U j i (.,.,.,.,.),Ua i (.,.,.,.,.),Θ i,g j i (.),Ga i (.) Unrestricted heterogeneity across women: θ i Γ θ (.) No cross-sectional predictions for a single policy regime (can rationalize anything w/ choice of Γ θ (.)) Only restrictions on pairing of responses across different regimes Consider implications of model for responses in terms of coarse earnings ranges + program participation categories Model rules out pairings between (but not within) earnings categories Analogous to budget patches of Kitamura and Stoye (2013)

Notation Earnings categories: Ẽ = 0 if E = 0 1 if 0 < E FPL 2 if E > FPL Earnings / Participation / Reporting States S {0n,1n,2n,0r,1r,1u,2u} n - nonparticipation, r - participation w/ truthful reporting, u - participation w/ under-reporting ( ) Si a,s j i denote woman i s potential states under AFDC/JF

Model restrictions Table 3: Allowed and Disallowed Responses State under AFDC State under Jobs First 0n 1n 2n 0r 1r 1u 2u 0n No Response Extensive LS (+) Take Up Welfare 1n No Response 2n No Response Intensive LS (+/0/ ) Take Up Welfare Intensive LS ( ) Take Up Welfare 0r No LS Response Exit Welfare Extensive LS (+) Exit Welfare Extensive LS (+) Exit Welfare No Response Extensive LS (+) Extensive LS (+) Under reporting 1r Intensive LS (+/0/ ) 1u 2u Intensive LS (+/0/ ) Truthful Reporting Intensive LS ( ) Truthful Reporting No Response

Response probabilities Joint Probability: ( Pr S j i = s j,si a = s a) ( = Pr S j i = s j Si a = s a) Pr(Si a = s a ). Sum over s a : ( Pr S j i = s j) ( = Pr S j i = s j Si a = s a) Pr(Si a = s a ). s a S In matrix notation: Observe: p j = Π p a. p j and p a are 7 1 vectors, identified by random assignment Π contains 7 6 unknown response probabilities denoted π s a,s j.

Response Probabilities State under Earnings / Reporting State under JF AFDC 0n 1n 2n 0r 1r 1u 2u 0n 1 π 0n,1r 0 0 0 π 0n,1r 0 0 1n 0 1 π 1n,1r 0 0 π 1n,1r 0 0 2n 0 0 1 π 2n,1r 0 π 2n,1r 0 0 1 π 0r π 0r,0n π 0r,1n π 0r,0n π 0r,2n 0r,2n π 0r,1r π 0r,2u π 0r,1n π 0r,1r 0 π 0r,2u 1r 0 0 0 0 1 0 0 1u 0 0 0 0 1 0 0 2u 0 0 0 0 π 2u,1r 0 1 π 2u,1r

Integrate out unobserved states State under Earnings / Reporting State under JF AFDC 0n 1n 2n 0p 1p 2p 0n 1 π 0n,1r 0 0 0 π 0n,1r 0 1n 0 1 π 1n,1r 0 0 π 1n,1r 0 2n 0 0 1 π 2n,1r 0 π 2n,1r 0 1 π 0p π 0r,0n π 0r,1n π 0r,0n π 0r,2n 0r,2n π 0r,1r π 0r,2u π 0r,1n π 0r,1r π 0r,2u 1p 0 0 0 0 1 0 2p 0 0 0 0 π 2u,1r 1 π 2u,1r

Identification A system of 5 (non-redundant) eq.s in 9 unknown π s: p j 0n pa 0n = p a 0nπ 0n,1r + p a 0pπ 0r,0n p j 1n pa 1n = p a 1nπ 1n,1r + p a 0pπ 0r,1n p j 2n pa 2n = p a 2nπ 2n,1r + p a 0pπ 0r,2n p j 0p pa 0p = p a 0p (π 0r,1n + π 0r,1r + π 0r,2u + π 0r,2n + π 0r,0n ) p j 2p pa 2p = p a 0pπ 0r,2u p a 2pπ 2u,1r Left hand side gives effects on distribution (net flows) rhs provides rationalization in distribution of effects (gross flows) Over-(partial)-identified: system implies 16 refutable inequality restrictions (listed in paper) Example: p j 0p pa 0p 0 (JF lowers fraction of women on welfare and not-working)

Bounds on response probabilities Bounds on 9 unknown π s solve a linear programming problem. Find analytical solutions via enumeration. Example: max { 0, pa 2n pj 2n p a 2n } π 2n,1r min 1, ( ) ( ) p2n a pj 2n + p0p a pj 0p p2n a, ( ) ( p2n a pj 2n + p0p a pj 0p p2n a ( ) ( p2n a pj 2n + p0p a pj 0p p2n a ( ) ( p2n a pj 2n + p0p a pj 0p p2n a ( ( ) ( p2n a pj 2n + p0p a pj 0p ) + ) ( + p0n a pj 0n ) ( + p2p a pj 2p ) ( + p1n a pj 1n p a 0n pj 0n ( ) ( ) p2n a ( p2n a pj 2n + p0p a pj 0p + p0n a pj 0n ( ) ( ) p2n a ( p2n a pj 2n + p0p a pj 0p + p2p a pj 2p p2n a ( ) ( ) ( p2n a pj 2n + p0p a pj 0p + p0n a pj 0n p2n a ), ), ) ) ( ) + p2p a pj 2p, ) ( + p1n a pj 1n ) ( + p1n a pj 1n, ), ) ) ( ) ( + p2p a pj 2p + p1n a pj 1n, )

Estimation and Inference Estimate bounds by evaluating max{.} and min{.} using sample ˆp. Two approaches to inference 1 Naive approach treat identity of binding constraint as known. Can then apply results of Imbens and Manski (2002). 2 Conservative inference treat all constraints as binding. Degenerate version of intersection bounds approach of Chernozhukov, Lee, and Rosen (2013).

Table 4: Probability of Earnings / Participation States Overall Overall Adjusted Jobs First AFDC Difference Jobs First AFDC Difference Pr(State=0n) 0.127 0.136 0.009 0.128 0.135 0.007 (0.006) (0.006) (0.008) Pr(State=1n) 0.076 0.130 0.055 0.078 0.126 0.048 (0.004) (0.005) (0.006) Pr(State=2n) 0.068 0.099 0.031 0.069 0.096 0.027 (0.004) (0.005) (0.006) Pr(State=0p) 0.366 0.440 0.074 0.359 0.449 0.090 (0.008) (0.008) (0.012) Pr(State=1p) 0.342 0.185 0.157 0.343 0.184 0.159 (0.008) (0.006) (0.009) Pr(State=2p) 0.022 0.009 0.013 0.023 0.009 0.014 (0.002) (0.001) (0.002) # of quarterly observations 16,226 16,268 16,226 16,268 Notes: Sample covers quarters 1 7 post random assignment during which individual is either always on or always off welfare. Sample units with kidcount missing are excluded. Number of state refers to earnings level, with 0 indicating no earnings, 1 indicating earnings below 3 times the monthly FPL, and 2 indicating earnings above 3FPL. The letter n indicates welfare nonparticipation throughout the quarter while the letter p indicates welfare participation throughout the quarter. Poverty line computed under assumption AU size is one greater than amount implied by baseline kidcount variable. Adjusted probabilities are adjusted via the propensity score reweighting algorithm described in the Appendix. Standard errors computed using 1,000 block bootstrap replications (resampling at case level).

Table 4: Probability of Earnings / Participation States Overall Overall Adjusted Jobs First AFDC Difference Jobs First AFDC Difference Pr(State=0n) 0.127 0.136 0.009 0.128 0.135 0.007 (0.006) (0.006) (0.008) Pr(State=1n) 0.076 0.130 0.055 0.078 0.126 0.048 (0.004) (0.005) (0.006) Pr(State=2n) 0.068 0.099 0.031 0.069 0.096 0.027 (0.004) (0.005) (0.006) Pr(State=0p) 0.366 0.440 0.074 0.359 0.449 0.090 (0.008) (0.008) (0.012) Pr(State=1p) 0.342 0.185 0.157 0.343 0.184 0.159 (0.008) (0.006) (0.009) Pr(State=2p) 0.022 0.009 0.013 0.023 0.009 0.014 (0.002) (0.001) (0.002) # of quarterly observations 16,226 16,268 16,226 16,268 Notes: Sample covers quarters 1 7 post random assignment during which individual is either always on or always off welfare. Sample units with kidcount missing are excluded. Number of state refers to earnings level, with 0 indicating no earnings, 1 indicating earnings below 3 times the monthly FPL, and 2 indicating earnings above 3FPL. The letter n indicates welfare nonparticipation throughout the quarter while the letter p indicates welfare participation throughout the quarter. Poverty line computed under assumption AU size is one greater than amount implied by baseline kidcount variable. Adjusted probabilities are adjusted via the propensity score reweighting algorithm described in the Appendix. Standard errors computed using 1,000 block bootstrap replications (resampling at case level).

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Table 5: Point and Set- identified Response Probabilities Response Type State Occupied under AFDC JF Symbol Estimate S.E. (a) General Specification of Preferences 95% CI (naive) 95% CI (conservative) 0n 1r π 0n,1r {0.055, 0.620} [0.000, 0.758] [0.000, 0.879] 1n 1r π 1n,1r {0.382, 0.987} [0.320, 1.000] [0.320, 1.000] 2n 1r π 2n,1r {0.280, 1.000} [0.193, 1.000] [0.193, 1.000] 0r 0n π 0r,0n {0.000, 0.170} [0.000, 0.211] [0.000, 0.247] Detailed " 1n π 0r,1n {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2n π 0r,2n {0.000, 0.154} [0.000, 0.171] [0.000, 0.304] " 1r π 0r,1r {0.000, 0.170} [0.000, 0.211] [0.000, 0.251] " 2u π 0r,2u {0.031, 0.051} [0.022, 0.058] [0.022, 0.131] 2u 1r π 2u,1r {0.000, 1.000} [0.000, 1.000] [0.000, 1.000] Not working Working π 0,1+ 0.167 0.020 [0.129, 0.206] [0.129, 0.206] Composite Off welfare On welfare π n,p {0.231, 0.445} [0.187, 0.487] [0.187, 0.510] On welfare Off welfare π p,n {0.000, 0.119} [0.000, 0.148] [0.000, 0.174] On welfare, not working Off welfare π 0r,n {0.000, 0.170} [0.000, 0.211] [0.000, 0.245] (b) Restricted Specification of Preferences Detailed 0r 1n π 0r,1n 0 1n 1r π 1n,1r 0.382 0.038 [0.308, 0.456] [0.308, 0.456]

Extension: Splitting the top earnings range Are the intensive margin earnings reductions associated with opt-in small? Split the top earnings range: 0 if E = 0 1 if E FPL i Ẽ i 2 if E (FPL i,1.2 FPL i ] 2 if E > 1.2 FPL i RP implies reform won t lead to switches between 2 and 2 Lower limits of 95% CIs on detailed opt-in probabilities: π 2n,1r.17 π 2n,1r.19 Bottom line: some opt-in responses involved substantial earnings reductions

Conclusion Substantial intensive and extensive margin responses to JF reform Consistent w/ BGH interpretation and other recent evidence (Blundell, Bozio, and Laroque, 2012) Artifact of JF notch as opposed to usual kink? Under-reporting behavior important for rationalizing impacts (JF increased prevalence of state 2p) Interaction between work requirements and fixed costs of work. Limitations of bunching approach: no bunching, but big impact.

Future work Revealed preference approach easily extended to quasi-experimental settings (e.g. EITC expansion, health care reform) Extrapolating responses to new regimes: Nonparametric approach requires lots of policy variation Further restrictions on model primitives Back to (semi-) parametric modeling? Dynamic Models Behavioral models / Violations of revealed preference?

The Jobs First Reform Jobs First Status Quo Welfare: Name of Program Temporary Family Assistance (TFA) Aid for Families with Dependent Children (AFDC) Eligibility Earnings below poverty line Earnings level at which benefits are exhausted Earnings disregards: Fixed diregard n.a $120 /mo. (first 12 months of work), $90 /mo. (after) Proportional disregard 100% 51% (first 4 months of work), 27% (after month 4) Time Limit 21 months None Work requirements Table 1: Summary of Differences Between Status Quo and Jobs First Policy Regimes Mandatory work first employment services (exempt if child <1) Education / training (exempt if child < 2) Other Features: Sanctions 3 month grant reduction due to infraction: 20% (1st), grant reduction corresponding to removal of adult from 35% (2nd), 100% (3rd); moderate enforcement AU; rarely enforced Asset Limit $3,000 $1,000 Family Cap $50 /mo. $100 /mo. Transitional Medicare 2 years 1 year Transitional Child Care As long as income is <75% of state median 1 year as long as income is <75% of state median Child Support $100 /mo. disregarded; full pass through $50 /mo. disregarded; $50 /mo. maximum pass through Food Stamps (if joint with welfare): Earning Disregards: Proportional disregard 100% up to poverty line 76% up to the eligibility threshold Back

A Test for Anticipation Table 6: Fraction of Months on Welfare by Experimental Status and Age of Youngest Child Age of Youngest Child at Baseline: 16 or 17 15 or less AFDC JF Difference 0.148 0.215 0.067 0.348 0.438 0.089 (0.074) (0.074) (0.053) (0.064) (0.064) (0.010) Difference in Differences - 0.023 (0.054) Notes: Sample consists of 87,717 case- months: 21 months of data on each of 4,177 cases with non- missing baseline information on age of youngest child. Table gives regression- adjusted fraction of case- months that women participated in welfare by experimental status and age of youngest child at baseline. Robust standard errors computed using clustering at case level. Time limits moot for women w/ children aged 16+ at baseline But effects of reform on participation are roughly the same

Effects of Time Limit on Participation Back