Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time

Size: px
Start display at page:

Download "Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time"

Transcription

1 Economics 2010c: Lectures 9-10 Bellman Equation in Continuous Time David Laibson 9/30/2014

2 Outline Lectures 9-10: 9.1 Continuous-time Bellman Equation 9.2 Application: Merton s Problem 9.3 Application: Stopping problem 9.4 Boundary condition: Value Matching 9.5 Boundary condition: Smooth Pasting 10.1 Stopping problem revisited 10.2 Solving second order ODE s 10.3Stoppingproblemresolved

3 1 Continuous-time Bellman Equation Let s write out the most general version of our problem. of motion of the state variable: Begin with equation = ( ) + ( ) Note that depends on choice of control. Using Ito s Lemma, derive continuous time Bellman Equation: ( ) = ( )+ + ( ) ( ) 2 = ( ) = optimal value of control variable

4 Note that value function is a second order partial differential equation (PDE). is the dependent variable and and are the independent variables. To solve this PDE need boundary conditions, since many solutions exist.

5 1.1 Terminal condition. Suppose problem ends at date Then we know that ( )=Ω( ) Can solve the problem using techniques analogous to backwards induction

6 1.2 Stationary horizon problem. Now value function doesn t depend on ( ) = ( )+ ( ) ( ) 2 00 We have a second-order ordinary differential equation (ODE). In general a large class of functions are consistent with this ODE. To pin down a solution we need to know something about the economics of the value function This will provide constraints that pick out a single solution.

7 2 Application: Merton s consumption problem Consumer has CRRA utility: ( ) = 1 1 Consumer has two assets. Risk free: return Equity: return + and proportional variance 2 Consumer invests asset share in equities and consumes at rate =[( + ) ] + so, ( ) =[( + ) ] and ( ) =

8 Bellman Equation and Ito s Lemma: ( ) = max max { ( ) + ( )} ( ( ) + " + ( ) ( )2 2 # ) For this problem, doesn t depend directly on (why?): ( " ( ) =max ( ) + [( + ) ] ( )2 # ) Boundary condition: ( ) = 1 1 So, 1 ½ =max ( ) + [( + ) ] ( ) ¾

9 First-order conditions: 2 µ 2 1 ( ) 2 =0 0 ( ) = = Simplification implies: = 2 = 1 Plugging this back into last equation on previous page implies: 1 = Ã + 1 1!Ã!

10 Interesting case: =1. = So ' 0 05 = 2 = (0 16) 2 =2 34! How many households place 2.34 times their wealth (including human capital) in the stock market?

11 3 Application: Stopping problem Every instant the firm decides whether to continue and get instantaneous flow payoff, ( ) or to stop and get termination payoff, Ω( ) We ll assume that ( ) is increasing in Continuous time value function is given by (limit as 0): ( ) =max n ( ) +(1+ ) 1 ( 0 0 ) Ω( ) o Assume that = ( ) + ( )

12 The solution to this problem is a stopping rule if ( ) continue if ( ) stop Motivation: Irreversibly closing a production facility.

13 Distinguish continuation region and stopping region of state space. The stopping region is the set of points h i such that ( ) ( ) In continuation region, use Ito s Lemma to characterize the value function: ( ) = ( ) + ( ) " = ( ) + + ( )+1 2 ( )2 2 2 # We need to solve this partial differential equation.

14 4 Value Matching Recall that Ω( ) is the termination payoff. One set of boundary conditions is for all boundary points, h ( ) i. lim ( ) ( ) =Ω( ( ) ) This is referred to as a value matching condition (continuity of the value function at the boundary).

15 Heuristic proof. There exists a neighborhood ( + ) in which: ( ) = ( ) +(1+ ) 1 ( 0 0 ) = ( ) +(1+ ) 1 " ( + 0 )+Ω( 0 ) 2 = 1 2 lim ( )+1 ( ) 2 Ω( ( ) )+ = lim ( )+1 ( ) 2 This implies that lim ( ) = lim ( ) which implies " Ω( ( ) ) ( ) ( )+1 2 " lim ( ) ( ) Ω( ( ) ) lim ( ) ( ) =Ω( ( ) ) # + lim ( ) ( ) # #

16 5 Smooth Pasting We could now apply backwards induction techniques if we knew the free boundary ( ). To pin down the free boundary, we need another boundary condition, which is derived from optimization and called smooth pasting: ( ( ) )=Ω ( ( ) )

17 Heuristic proof. Suppose slopes to left and right of stopping point are given by and + where 0 This is a convex kink. If you stop now you get payoff Ω Ifyouwaitanotherinstantandthenstop,yougetpayoff: +(1+ ) 1 " So the net payoff of waiting is +(1+ ) 1 " Ω 2 Ω 2 + ( + ) 2 + ( + ) # 2 " = +(1+ ) 1 Ω # Ω + # 2 Ω Multiply through by (1 + ) simplify and remove terms of at least order to find: (1 + ) + " Ω + 2 # (1 + )Ω = 2

18 Intuition: At the boundary, the agent should be indifferent between continuation and stopping. If value functions don t smooth paste at ( ), thenstoppingat ( ) can t be optimal. Better to stop an instant later. If there is a (convex) kink at the boundary, then the gain from waiting is in and the cost from waiting is in So there can t be a kink at the boundary. Hence: ( ( ) )=Ω ( ( ) ) How would you rule out concave kinks?

19 Outline Lectures 9-10: 9.1 Continuous-time Bellman Equation 9.2 Application: Merton s Problem 9.3 Application: Stopping problem 9.4 Boundary condition: Value Matching 9.5 Boundary condition: Smooth Pasting 10.1 Stopping problem revisited 10.2 Solving second order ODE s 10.3Stoppingproblemresolved

20 6 Stopping Problem Revisited Assume that a continuous time stochastic process ( ) is an Ito process, = + You might imagine that is the price of a commodity produced by this firm. While in operation, the firm has flow profit ( ) = Assume that the firm can always costlessly (permanently) exit the industry and realize termination payoff Ω =0 Intuitively, this firm will have a stationary stopping rule, if continue if stop (exit)

21 Let 0 = ( + ) and let represent the interest rate. So ( ) =max n +(1+ ) 1 ( 0 ) 0 o In the stopping region, In the continuation region, ( ) =0 ( ) = +(1+ ) 1 ( 0 ) (1 + ) ( ) =(1+ ) + ( 0 ) ( ) =(1+ ) + ( 0 ) ( ) Multiply out and let 0 Terms of order 2 =0 ( ) = + ( ) (*)

22 Now substitute in for ( ) using Ito s Lemma: " ( ) = + ( )+1 2 ( )2 2 2 " # 00 = Substituting this expression into equation (*), we find ( ) = + " # 00 which is a second-order ordinary differential equation, = #

23 What are our boundary conditions? Value matching: Smooth pasting: ( )=0 0 ( )=0 As the option value of exiting goes to zero, so converges to the value associated with the policy of never exiting the industry. Hence, lim 1 ( ) ³ =1 + We ll derive this equation later. We could also have written lim 0 ( ) = 1

24 7 Solving second order ODE s To solve the differential equations that come up in economics, it is helpful to recall a few general results from the theory of differential equations. Consider a generic second order ordinary differential equation: 00 ( )+ ( ) 0 ( )+ ( ) ( ) = ( ) This equation is referred to as the complete equation. Note that ( ), ( ), and ( ), are given functions. We are trying to solve for with independendent variable. Now consider a reduced equation in which ( ) is replaced by ( )+ ( ) 0 ( )+ ( ) ( ) =0 Solving this reduced differential equation will enable us to solve the complete equation. We begin by characterizing the solution of the reduced equation.

25 Theorem 7.1 Any solution, ˆ ( ), of the reduced equation can be expressed as a linear combination of any two solutions of the reduced equation, 1 and 2 that are linearly independent. ˆ ( ) = 1 1 ( )+ 2 2 ( ) Note that two solutions are linearly independent if there do not exist constants 1 and 2 such that 1 1 ( )+ 2 2 ( ) =0 for all Theorem 7.2 The general solution of the complete equation is the sum of any particular solution of the complete equation and the general solution of the reduced equation.

26 8 Stopping problem resolved Recall the differential equation that characterizes the continuation region = (complete equation) Consider the reduced equation, 0= (reduced equation) Our first challenge is to find solutions of this equation. Consider the class, To confirm that this is in fact a solution, differentiate and plug in to find 0=

27 This implies that Apply quadratic formula, 0= = ± q Let + represent the positive root and let represent the negative root. Any solution to the reduced equation can be expressed (general solution to the reduced equation)

28 The general solution to the complete equation can be expressed as the sum of a particular solution to the complete differential equation and the general solution to the reduced equation. To find a particular solution, consider the payoff function of the policy never leave the industry. The value of this policy is Note that [ ( )] = Z 0 ( ) (0) + Z 0 ( ) Z = (0) + [ + ( )] 0 Z = (0) + + ( ) 0 = (0) +

29 The value of the policy never leave is derived with integration by parts: Z 0 ( ) = Z 0 = (0) + Ã [ (0) + ] " 1! # 0 Z 0 1 = 1 (0) + Hence, our (candidate) particular solution takes the form ( ) = 1 + Confirm that this is a solution to the complete differential equation. " 1 Ã +!# Ã! = X

30 We now can draw all of these pieces together. solution to the reduced equation First, we have our general where the roots are given by q + = ± Second, we have our particular solution: 1 + So the general solution of the complete equation is ( ) = 1 Ã Ã +!!

31 Finally, we have boundary conditions. Value matching: ( )=0 Smooth pasting: 0 ( )=0

32 We know lim 0 ( ) = 1 which implies + =0 Value matching and smooth pasting imply ( )= 1 Ã +! + =0 (1) 0 ( )= 1 + =0 (2) Equation (1) implies = 1 Ã! +

33 Plugging this expression into equation (2) implies Hence, We have, Hence, 1 Ã +! = 1 =0 q = = q

34 Some interesting special cases (see problem set): ( =0) = 2 0 lim = lim = 0 lim 0 = lim ( if 0 0 if 0 = ( if 0 lim 0 = lim = if 0 ) )

35 Illustrative calibration: ( =0) = 2 = 2 02 = 5 Wait until the gets 5 standard deviations below the break-even threshold ( =0) before shutting down.

36 Finally, now that we have our solution, it is easy to calculate the option value of stopping: Ã! ( ) = ( ) 1 + Substituting in for ( ) yields ( ) = ³ if + if 1 So as the option value of stopping goes to zero.

37 Outline Lectures 9-10: 9.1 Continuous-time Bellman Equation 9.2 Application: Merton s Problem 9.3 Application: Stopping problem 9.4 Boundary condition: Value Matching 9.5 Boundary condition: Smooth Pasting 10.1 Stopping problem revisited 10.2 Solving second order ODE s 10.3Stoppingproblemresolved

Economics 2010c: Lecture 2 Iterative Methods in Dynamic Programming

Economics 2010c: Lecture 2 Iterative Methods in Dynamic Programming Economics 2010c: Lecture 2 Iterative Methods in Dynamic Programming David Laibson 9/04/2014 Outline: 1. Functional operators 2. Iterative solutions for the Bellman Equation 3. Contraction Mapping Theorem

More information

1 Bewley Economies with Aggregate Uncertainty

1 Bewley Economies with Aggregate Uncertainty 1 Bewley Economies with Aggregate Uncertainty Sofarwehaveassumedawayaggregatefluctuations (i.e., business cycles) in our description of the incomplete-markets economies with uninsurable idiosyncratic risk

More information

Advanced Macroeconomics

Advanced Macroeconomics Advanced Macroeconomics The Ramsey Model Marcin Kolasa Warsaw School of Economics Marcin Kolasa (WSE) Ad. Macro - Ramsey model 1 / 30 Introduction Authors: Frank Ramsey (1928), David Cass (1965) and Tjalling

More information

Economics 2010c: Lecture 3 The Classical Consumption Model

Economics 2010c: Lecture 3 The Classical Consumption Model Economics 2010c: Lecture 3 The Classical Consumption Model David Laibson 9/9/2014 Outline: 1. Consumption: Basic model and early theories 2. Linearization of the Euler Equation 3. Empirical tests without

More information

Slides II - Dynamic Programming

Slides II - Dynamic Programming Slides II - Dynamic Programming Julio Garín University of Georgia Macroeconomic Theory II (Ph.D.) Spring 2017 Macroeconomic Theory II Slides II - Dynamic Programming Spring 2017 1 / 32 Outline 1. Lagrangian

More information

Area I: Contract Theory Question (Econ 206)

Area I: Contract Theory Question (Econ 206) Theory Field Exam Summer 2011 Instructions You must complete two of the four areas (the areas being (I) contract theory, (II) game theory A, (III) game theory B, and (IV) psychology & economics). Be sure

More information

Dynamic Macroeconomic Theory Notes. David L. Kelly. Department of Economics University of Miami Box Coral Gables, FL

Dynamic Macroeconomic Theory Notes. David L. Kelly. Department of Economics University of Miami Box Coral Gables, FL Dynamic Macroeconomic Theory Notes David L. Kelly Department of Economics University of Miami Box 248126 Coral Gables, FL 33134 dkelly@miami.edu Current Version: Fall 2013/Spring 2013 I Introduction A

More information

Appendix (For Online Publication) Community Development by Public Wealth Accumulation

Appendix (For Online Publication) Community Development by Public Wealth Accumulation March 219 Appendix (For Online Publication) to Community Development by Public Wealth Accumulation Levon Barseghyan Department of Economics Cornell University Ithaca NY 14853 lb247@cornell.edu Stephen

More information

Equilibrium in a Production Economy

Equilibrium in a Production Economy Equilibrium in a Production Economy Prof. Eric Sims University of Notre Dame Fall 2012 Sims (ND) Equilibrium in a Production Economy Fall 2012 1 / 23 Production Economy Last time: studied equilibrium in

More information

Lecture 2 The Centralized Economy

Lecture 2 The Centralized Economy Lecture 2 The Centralized Economy Economics 5118 Macroeconomic Theory Kam Yu Winter 2013 Outline 1 Introduction 2 The Basic DGE Closed Economy 3 Golden Rule Solution 4 Optimal Solution The Euler Equation

More information

2. What is the fraction of aggregate savings due to the precautionary motive? (These two questions are analyzed in the paper by Ayiagari)

2. What is the fraction of aggregate savings due to the precautionary motive? (These two questions are analyzed in the paper by Ayiagari) University of Minnesota 8107 Macroeconomic Theory, Spring 2012, Mini 1 Fabrizio Perri Stationary equilibria in economies with Idiosyncratic Risk and Incomplete Markets We are now at the point in which

More information

New Notes on the Solow Growth Model

New Notes on the Solow Growth Model New Notes on the Solow Growth Model Roberto Chang September 2009 1 The Model The firstingredientofadynamicmodelisthedescriptionofthetimehorizon. In the original Solow model, time is continuous and the

More information

Monetary Economics: Solutions Problem Set 1

Monetary Economics: Solutions Problem Set 1 Monetary Economics: Solutions Problem Set 1 December 14, 2006 Exercise 1 A Households Households maximise their intertemporal utility function by optimally choosing consumption, savings, and the mix of

More information

Worst Case Portfolio Optimization and HJB-Systems

Worst Case Portfolio Optimization and HJB-Systems Worst Case Portfolio Optimization and HJB-Systems Ralf Korn and Mogens Steffensen Abstract We formulate a portfolio optimization problem as a game where the investor chooses a portfolio and his opponent,

More information

Dynamic Problem Set 1 Solutions

Dynamic Problem Set 1 Solutions Dynamic Problem Set 1 Solutions Jonathan Kreamer July 15, 2011 Question 1 Consider the following multi-period optimal storage problem: An economic agent imizes: c t} T β t u(c t ) (1) subject to the period-by-period

More information

Economics 210B Due: September 16, Problem Set 10. s.t. k t+1 = R(k t c t ) for all t 0, and k 0 given, lim. and

Economics 210B Due: September 16, Problem Set 10. s.t. k t+1 = R(k t c t ) for all t 0, and k 0 given, lim. and Economics 210B Due: September 16, 2010 Problem 1: Constant returns to saving Consider the following problem. c0,k1,c1,k2,... β t Problem Set 10 1 α c1 α t s.t. k t+1 = R(k t c t ) for all t 0, and k 0

More information

CSE250A Fall 12: Discussion Week 9

CSE250A Fall 12: Discussion Week 9 CSE250A Fall 12: Discussion Week 9 Aditya Menon (akmenon@ucsd.edu) December 4, 2012 1 Schedule for today Recap of Markov Decision Processes. Examples: slot machines and maze traversal. Planning and learning.

More information

Advanced Macroeconomics

Advanced Macroeconomics Advanced Macroeconomics The Ramsey Model Micha l Brzoza-Brzezina/Marcin Kolasa Warsaw School of Economics Micha l Brzoza-Brzezina/Marcin Kolasa (WSE) Ad. Macro - Ramsey model 1 / 47 Introduction Authors:

More information

September Math Course: First Order Derivative

September Math Course: First Order Derivative September Math Course: First Order Derivative Arina Nikandrova Functions Function y = f (x), where x is either be a scalar or a vector of several variables (x,..., x n ), can be thought of as a rule which

More information

Introduction to Continuous-Time Dynamic Optimization: Optimal Control Theory

Introduction to Continuous-Time Dynamic Optimization: Optimal Control Theory Econ 85/Chatterjee Introduction to Continuous-ime Dynamic Optimization: Optimal Control heory 1 States and Controls he concept of a state in mathematical modeling typically refers to a specification of

More information

1 Markov decision processes

1 Markov decision processes 2.997 Decision-Making in Large-Scale Systems February 4 MI, Spring 2004 Handout #1 Lecture Note 1 1 Markov decision processes In this class we will study discrete-time stochastic systems. We can describe

More information

Lecture XI. Approximating the Invariant Distribution

Lecture XI. Approximating the Invariant Distribution Lecture XI Approximating the Invariant Distribution Gianluca Violante New York University Quantitative Macroeconomics G. Violante, Invariant Distribution p. 1 /24 SS Equilibrium in the Aiyagari model G.

More information

Information Choice in Macroeconomics and Finance.

Information Choice in Macroeconomics and Finance. Information Choice in Macroeconomics and Finance. Laura Veldkamp New York University, Stern School of Business, CEPR and NBER Spring 2009 1 Veldkamp What information consumes is rather obvious: It consumes

More information

Department of Agricultural Economics. PhD Qualifier Examination. May 2009

Department of Agricultural Economics. PhD Qualifier Examination. May 2009 Department of Agricultural Economics PhD Qualifier Examination May 009 Instructions: The exam consists of six questions. You must answer all questions. If you need an assumption to complete a question,

More information

Dynamic Optimization: An Introduction

Dynamic Optimization: An Introduction Dynamic Optimization An Introduction M. C. Sunny Wong University of San Francisco University of Houston, June 20, 2014 Outline 1 Background What is Optimization? EITM: The Importance of Optimization 2

More information

Discussion Papers in Economics

Discussion Papers in Economics Discussion Papers in Economics No. 10/11 A General Equilibrium Corporate Finance Theorem for Incomplete Markets: A Special Case By Pascal Stiefenhofer, University of York Department of Economics and Related

More information

Chapter 4. Applications/Variations

Chapter 4. Applications/Variations Chapter 4 Applications/Variations 149 4.1 Consumption Smoothing 4.1.1 The Intertemporal Budget Economic Growth: Lecture Notes For any given sequence of interest rates {R t } t=0, pick an arbitrary q 0

More information

1. Using the model and notations covered in class, the expected returns are:

1. Using the model and notations covered in class, the expected returns are: Econ 510a second half Yale University Fall 2006 Prof. Tony Smith HOMEWORK #5 This homework assignment is due at 5PM on Friday, December 8 in Marnix Amand s mailbox. Solution 1. a In the Mehra-Prescott

More information

Uncertainty Per Krusell & D. Krueger Lecture Notes Chapter 6

Uncertainty Per Krusell & D. Krueger Lecture Notes Chapter 6 1 Uncertainty Per Krusell & D. Krueger Lecture Notes Chapter 6 1 A Two-Period Example Suppose the economy lasts only two periods, t =0, 1. The uncertainty arises in the income (wage) of period 1. Not that

More information

ECON 5118 Macroeconomic Theory

ECON 5118 Macroeconomic Theory ECON 5118 Macroeconomic Theory Winter 013 Test 1 February 1, 013 Answer ALL Questions Time Allowed: 1 hour 0 min Attention: Please write your answers on the answer book provided Use the right-side pages

More information

Review of Optimization Methods

Review of Optimization Methods Review of Optimization Methods Prof. Manuela Pedio 20550 Quantitative Methods for Finance August 2018 Outline of the Course Lectures 1 and 2 (3 hours, in class): Linear and non-linear functions on Limits,

More information

Macroeconomics Theory II

Macroeconomics Theory II Macroeconomics Theory II Francesco Franco FEUNL February 2016 Francesco Franco (FEUNL) Macroeconomics Theory II February 2016 1 / 18 Road Map Research question: we want to understand businesses cycles.

More information

Lecture 1. Evolution of Market Concentration

Lecture 1. Evolution of Market Concentration Lecture 1 Evolution of Market Concentration Take a look at : Doraszelski and Pakes, A Framework for Applied Dynamic Analysis in IO, Handbook of I.O. Chapter. (see link at syllabus). Matt Shum s notes are

More information

B Search and Rest Unemployment Fernando Alvarez and Robert Shimer Additional Appendixes not for Publication

B Search and Rest Unemployment Fernando Alvarez and Robert Shimer Additional Appendixes not for Publication B Search and Rest Unemployment Fernando Alvarez and Robert Shimer Additional Appendixes not for Publication B.1 Derivation Hamilton-Jacobi-Bellman This appendix proves that if v() is given by: v() = R(

More information

HJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011

HJB equations. Seminar in Stochastic Modelling in Economics and Finance January 10, 2011 Department of Probability and Mathematical Statistics Faculty of Mathematics and Physics, Charles University in Prague petrasek@karlin.mff.cuni.cz Seminar in Stochastic Modelling in Economics and Finance

More information

Lecture 6: Discrete-Time Dynamic Optimization

Lecture 6: Discrete-Time Dynamic Optimization Lecture 6: Discrete-Time Dynamic Optimization Yulei Luo Economics, HKU November 13, 2017 Luo, Y. (Economics, HKU) ECON0703: ME November 13, 2017 1 / 43 The Nature of Optimal Control In static optimization,

More information

General Examination in Macroeconomic Theory SPRING 2013

General Examination in Macroeconomic Theory SPRING 2013 HARVARD UNIVERSITY DEPARTMENT OF ECONOMICS General Examination in Macroeconomic Theory SPRING 203 You have FOUR hours. Answer all questions Part A (Prof. Laibson): 48 minutes Part B (Prof. Aghion): 48

More information

Lecture 2. (1) Aggregation (2) Permanent Income Hypothesis. Erick Sager. September 14, 2015

Lecture 2. (1) Aggregation (2) Permanent Income Hypothesis. Erick Sager. September 14, 2015 Lecture 2 (1) Aggregation (2) Permanent Income Hypothesis Erick Sager September 14, 2015 Econ 605: Adv. Topics in Macroeconomics Johns Hopkins University, Fall 2015 Erick Sager Lecture 2 (9/14/15) 1 /

More information

In the Ramsey model we maximized the utility U = u[c(t)]e nt e t dt. Now

In the Ramsey model we maximized the utility U = u[c(t)]e nt e t dt. Now PERMANENT INCOME AND OPTIMAL CONSUMPTION On the previous notes we saw how permanent income hypothesis can solve the Consumption Puzzle. Now we use this hypothesis, together with assumption of rational

More information

Advanced Microeconomic Analysis Solutions to Midterm Exam

Advanced Microeconomic Analysis Solutions to Midterm Exam Advanced Microeconomic Analsis Solutions to Midterm Exam Q1. (0 pts) An individual consumes two goods x 1 x and his utilit function is: u(x 1 x ) = [min(x 1 + x x 1 + x )] (a) Draw some indifference curves

More information

Small Open Economy RBC Model Uribe, Chapter 4

Small Open Economy RBC Model Uribe, Chapter 4 Small Open Economy RBC Model Uribe, Chapter 4 1 Basic Model 1.1 Uzawa Utility E 0 t=0 θ t U (c t, h t ) θ 0 = 1 θ t+1 = β (c t, h t ) θ t ; β c < 0; β h > 0. Time-varying discount factor With a constant

More information

Industrial Organization Lecture 7: Product Differentiation

Industrial Organization Lecture 7: Product Differentiation Industrial Organization Lecture 7: Product Differentiation Nicolas Schutz Nicolas Schutz Product Differentiation 1 / 57 Introduction We now finally drop the assumption that firms offer homogeneous products.

More information

problem. max Both k (0) and h (0) are given at time 0. (a) Write down the Hamilton-Jacobi-Bellman (HJB) Equation in the dynamic programming

problem. max Both k (0) and h (0) are given at time 0. (a) Write down the Hamilton-Jacobi-Bellman (HJB) Equation in the dynamic programming 1. Endogenous Growth with Human Capital Consider the following endogenous growth model with both physical capital (k (t)) and human capital (h (t)) in continuous time. The representative household solves

More information

The Real Business Cycle Model

The Real Business Cycle Model The Real Business Cycle Model Macroeconomics II 2 The real business cycle model. Introduction This model explains the comovements in the fluctuations of aggregate economic variables around their trend.

More information

Chapter 4: Production Theory

Chapter 4: Production Theory Chapter 4: Production Theory Need to complete: Proposition 48, Proposition 52, Problem 4, Problem 5, Problem 6, Problem 7, Problem 10. In this chapter we study production theory in a commodity space. First,

More information

Dynamic stochastic game and macroeconomic equilibrium

Dynamic stochastic game and macroeconomic equilibrium Dynamic stochastic game and macroeconomic equilibrium Tianxiao Zheng SAIF 1. Introduction We have studied single agent problems. However, macro-economy consists of a large number of agents including individuals/households,

More information

Macroeconomic Theory II Homework 2 - Solution

Macroeconomic Theory II Homework 2 - Solution Macroeconomic Theory II Homework 2 - Solution Professor Gianluca Violante, TA: Diego Daruich New York University Spring 204 Problem The household has preferences over the stochastic processes of a single

More information

Econ Slides from Lecture 10

Econ Slides from Lecture 10 Econ 205 Sobel Econ 205 - Slides from Lecture 10 Joel Sobel September 2, 2010 Example Find the tangent plane to {x x 1 x 2 x 2 3 = 6} R3 at x = (2, 5, 2). If you let f (x) = x 1 x 2 x3 2, then this is

More information

Economic Growth: Lecture 9, Neoclassical Endogenous Growth

Economic Growth: Lecture 9, Neoclassical Endogenous Growth 14.452 Economic Growth: Lecture 9, Neoclassical Endogenous Growth Daron Acemoglu MIT November 28, 2017. Daron Acemoglu (MIT) Economic Growth Lecture 9 November 28, 2017. 1 / 41 First-Generation Models

More information

Ramsey Cass Koopmans Model (1): Setup of the Model and Competitive Equilibrium Path

Ramsey Cass Koopmans Model (1): Setup of the Model and Competitive Equilibrium Path Ramsey Cass Koopmans Model (1): Setup of the Model and Competitive Equilibrium Path Ryoji Ohdoi Dept. of Industrial Engineering and Economics, Tokyo Tech This lecture note is mainly based on Ch. 8 of Acemoglu

More information

Birgit Rudloff Operations Research and Financial Engineering, Princeton University

Birgit Rudloff Operations Research and Financial Engineering, Princeton University TIME CONSISTENT RISK AVERSE DYNAMIC DECISION MODELS: AN ECONOMIC INTERPRETATION Birgit Rudloff Operations Research and Financial Engineering, Princeton University brudloff@princeton.edu Alexandre Street

More information

9 - Markov processes and Burt & Allison 1963 AGEC

9 - Markov processes and Burt & Allison 1963 AGEC This document was generated at 8:37 PM on Saturday, March 17, 2018 Copyright 2018 Richard T. Woodward 9 - Markov processes and Burt & Allison 1963 AGEC 642-2018 I. What is a Markov Chain? A Markov chain

More information

1. Money in the utility function (start)

1. Money in the utility function (start) Monetary Economics: Macro Aspects, 1/3 2012 Henrik Jensen Department of Economics University of Copenhagen 1. Money in the utility function (start) a. The basic money-in-the-utility function model b. Optimal

More information

A Rothschild-Stiglitz approach to Bayesian persuasion

A Rothschild-Stiglitz approach to Bayesian persuasion A Rothschild-Stiglitz approach to Bayesian persuasion Matthew Gentzkow and Emir Kamenica Stanford University and University of Chicago December 2015 Abstract Rothschild and Stiglitz (1970) represent random

More information

"0". Doing the stuff on SVARs from the February 28 slides

0. Doing the stuff on SVARs from the February 28 slides Monetary Policy, 7/3 2018 Henrik Jensen Department of Economics University of Copenhagen "0". Doing the stuff on SVARs from the February 28 slides 1. Money in the utility function (start) a. The basic

More information

Online Appendix to A search model of costly product returns by Vaiva Petrikaitė

Online Appendix to A search model of costly product returns by Vaiva Petrikaitė Online Appendix to A search model of costly product returns by Vaiva Petrikaitė 27 May A Early returns Suppose that a consumer must return one product before buying another one. This may happen due to

More information

A Rothschild-Stiglitz approach to Bayesian persuasion

A Rothschild-Stiglitz approach to Bayesian persuasion A Rothschild-Stiglitz approach to Bayesian persuasion Matthew Gentzkow and Emir Kamenica Stanford University and University of Chicago September 2015 Abstract Rothschild and Stiglitz (1970) introduce a

More information

Topic 2. Consumption/Saving and Productivity shocks

Topic 2. Consumption/Saving and Productivity shocks 14.452. Topic 2. Consumption/Saving and Productivity shocks Olivier Blanchard April 2006 Nr. 1 1. What starting point? Want to start with a model with at least two ingredients: Shocks, so uncertainty.

More information

ECOM 009 Macroeconomics B. Lecture 2

ECOM 009 Macroeconomics B. Lecture 2 ECOM 009 Macroeconomics B Lecture 2 Giulio Fella c Giulio Fella, 2014 ECOM 009 Macroeconomics B - Lecture 2 40/197 Aim of consumption theory Consumption theory aims at explaining consumption/saving decisions

More information

GENERAL EQUILIBRIUM: EXCESS DEMAND AND THE RÔLE OF PRICES

GENERAL EQUILIBRIUM: EXCESS DEMAND AND THE RÔLE OF PRICES Prerequisites Almost essential General equilibrium: Basics Useful, but optional General Equilibrium: Price Taking GENERAL EQUILIBRIUM: EXCESS DEMAND AND THE RÔLE OF PRICES MICROECONOMICS Principles and

More information

ECON 582: Dynamic Programming (Chapter 6, Acemoglu) Instructor: Dmytro Hryshko

ECON 582: Dynamic Programming (Chapter 6, Acemoglu) Instructor: Dmytro Hryshko ECON 582: Dynamic Programming (Chapter 6, Acemoglu) Instructor: Dmytro Hryshko Indirect Utility Recall: static consumer theory; J goods, p j is the price of good j (j = 1; : : : ; J), c j is consumption

More information

ECOM 009 Macroeconomics B. Lecture 3

ECOM 009 Macroeconomics B. Lecture 3 ECOM 009 Macroeconomics B Lecture 3 Giulio Fella c Giulio Fella, 2014 ECOM 009 Macroeconomics B - Lecture 3 84/197 Predictions of the PICH 1. Marginal propensity to consume out of wealth windfalls 0.03.

More information

Simple Regression Model. January 24, 2011

Simple Regression Model. January 24, 2011 Simple Regression Model January 24, 2011 Outline Descriptive Analysis Causal Estimation Forecasting Regression Model We are actually going to derive the linear regression model in 3 very different ways

More information

Optimal Control. Macroeconomics II SMU. Ömer Özak (SMU) Economic Growth Macroeconomics II 1 / 112

Optimal Control. Macroeconomics II SMU. Ömer Özak (SMU) Economic Growth Macroeconomics II 1 / 112 Optimal Control Ömer Özak SMU Macroeconomics II Ömer Özak (SMU) Economic Growth Macroeconomics II 1 / 112 Review of the Theory of Optimal Control Section 1 Review of the Theory of Optimal Control Ömer

More information

Lecture 4 The Centralized Economy: Extensions

Lecture 4 The Centralized Economy: Extensions Lecture 4 The Centralized Economy: Extensions Leopold von Thadden University of Mainz and ECB (on leave) Advanced Macroeconomics, Winter Term 2013 1 / 36 I Motivation This Lecture considers some applications

More information

Bi-Variate Functions - ACTIVITES

Bi-Variate Functions - ACTIVITES Bi-Variate Functions - ACTIVITES LO1. Students to consolidate basic meaning of bi-variate functions LO2. Students to learn how to confidently use bi-variate functions in economics Students are given the

More information

Second Welfare Theorem

Second Welfare Theorem Second Welfare Theorem Econ 2100 Fall 2015 Lecture 18, November 2 Outline 1 Second Welfare Theorem From Last Class We want to state a prove a theorem that says that any Pareto optimal allocation is (part

More information

Regularity of competitive equilibria in a production economy with externalities

Regularity of competitive equilibria in a production economy with externalities Regularity of competitive equilibria in a production economy with externalities Elena del Mercato Vincenzo Platino Paris School of Economics - Université Paris 1 Panthéon Sorbonne QED-Jamboree Copenhagen,

More information

Increasingly, economists are asked not just to study or explain or interpret markets, but to design them.

Increasingly, economists are asked not just to study or explain or interpret markets, but to design them. What is market design? Increasingly, economists are asked not just to study or explain or interpret markets, but to design them. This requires different tools and ideas than neoclassical economics, which

More information

DYNAMIC LECTURE 5: DISCRETE TIME INTERTEMPORAL OPTIMIZATION

DYNAMIC LECTURE 5: DISCRETE TIME INTERTEMPORAL OPTIMIZATION DYNAMIC LECTURE 5: DISCRETE TIME INTERTEMPORAL OPTIMIZATION UNIVERSITY OF MARYLAND: ECON 600. Alternative Methods of Discrete Time Intertemporal Optimization We will start by solving a discrete time intertemporal

More information

The Ramsey Model. Alessandra Pelloni. October TEI Lecture. Alessandra Pelloni (TEI Lecture) Economic Growth October / 61

The Ramsey Model. Alessandra Pelloni. October TEI Lecture. Alessandra Pelloni (TEI Lecture) Economic Growth October / 61 The Ramsey Model Alessandra Pelloni TEI Lecture October 2015 Alessandra Pelloni (TEI Lecture) Economic Growth October 2015 1 / 61 Introduction Introduction Introduction Ramsey-Cass-Koopmans model: di ers

More information

Macroeconomics Qualifying Examination

Macroeconomics Qualifying Examination Macroeconomics Qualifying Examination August 2015 Department of Economics UNC Chapel Hill Instructions: This examination consists of 4 questions. Answer all questions. If you believe a question is ambiguously

More information

TOBB-ETU - Econ 532 Practice Problems II (Solutions)

TOBB-ETU - Econ 532 Practice Problems II (Solutions) TOBB-ETU - Econ 532 Practice Problems II (Solutions) Q: Ramsey Model: Exponential Utility Assume that in nite-horizon households maximize a utility function of the exponential form 1R max U = e (n )t (1=)e

More information

2 Lecture Span, Basis and Dimensions

2 Lecture Span, Basis and Dimensions 2 Lecture 2 2.1 Span, Basis and Dimensions Related to the concept of a linear combination is that of the span. The span of a collection of objects is the set of all linear combinations of those objects

More information

FINM6900 Finance Theory Noisy Rational Expectations Equilibrium for Multiple Risky Assets

FINM6900 Finance Theory Noisy Rational Expectations Equilibrium for Multiple Risky Assets FINM69 Finance Theory Noisy Rational Expectations Equilibrium for Multiple Risky Assets February 3, 212 Reference Anat R. Admati, A Noisy Rational Expectations Equilibrium for Multi-Asset Securities Markets,

More information

ECON 2010c Solution to Problem Set 1

ECON 2010c Solution to Problem Set 1 ECON 200c Solution to Problem Set By the Teaching Fellows for ECON 200c Fall 204 Growth Model (a) Defining the constant κ as: κ = ln( αβ) + αβ αβ ln(αβ), the problem asks us to show that the following

More information

A Rothschild-Stiglitz approach to Bayesian persuasion

A Rothschild-Stiglitz approach to Bayesian persuasion A Rothschild-Stiglitz approach to Bayesian persuasion Matthew Gentzkow and Emir Kamenica Stanford University and University of Chicago January 2016 Consider a situation where one person, call him Sender,

More information

Growth Theory: Review

Growth Theory: Review Growth Theory: Review Lecture 1, Endogenous Growth Economic Policy in Development 2, Part 2 March 2009 Lecture 1, Exogenous Growth 1/104 Economic Policy in Development 2, Part 2 Outline Growth Accounting

More information

In the benchmark economy, we restrict ourselves to stationary equilibria. The individual

In the benchmark economy, we restrict ourselves to stationary equilibria. The individual 1 1. Appendix A: Definition of Stationary Equilibrium In the benchmark economy, we restrict ourselves to stationary equilibria. The individual state variables are deposit holdings, d, mortgage balances,

More information

Lecture 15. Dynamic Stochastic General Equilibrium Model. Randall Romero Aguilar, PhD I Semestre 2017 Last updated: July 3, 2017

Lecture 15. Dynamic Stochastic General Equilibrium Model. Randall Romero Aguilar, PhD I Semestre 2017 Last updated: July 3, 2017 Lecture 15 Dynamic Stochastic General Equilibrium Model Randall Romero Aguilar, PhD I Semestre 2017 Last updated: July 3, 2017 Universidad de Costa Rica EC3201 - Teoría Macroeconómica 2 Table of contents

More information

Economic Growth: Lecture 8, Overlapping Generations

Economic Growth: Lecture 8, Overlapping Generations 14.452 Economic Growth: Lecture 8, Overlapping Generations Daron Acemoglu MIT November 20, 2018 Daron Acemoglu (MIT) Economic Growth Lecture 8 November 20, 2018 1 / 46 Growth with Overlapping Generations

More information

Dynamic Risk Measures and Nonlinear Expectations with Markov Chain noise

Dynamic Risk Measures and Nonlinear Expectations with Markov Chain noise Dynamic Risk Measures and Nonlinear Expectations with Markov Chain noise Robert J. Elliott 1 Samuel N. Cohen 2 1 Department of Commerce, University of South Australia 2 Mathematical Insitute, University

More information

slides chapter 3 an open economy with capital

slides chapter 3 an open economy with capital slides chapter 3 an open economy with capital Princeton University Press, 2017 Motivation In this chaper we introduce production and physical capital accumulation. Doing so will allow us to address two

More information

Advanced Microeconomic Analysis, Lecture 6

Advanced Microeconomic Analysis, Lecture 6 Advanced Microeconomic Analysis, Lecture 6 Prof. Ronaldo CARPIO April 10, 017 Administrative Stuff Homework # is due at the end of class. I will post the solutions on the website later today. The midterm

More information

EconS Oligopoly - Part 2

EconS Oligopoly - Part 2 EconS 305 - Oligopoly - Part 2 Eric Dunaway Washington State University eric.dunaway@wsu.edu November 29, 2015 Eric Dunaway (WSU) EconS 305 - Lecture 32 November 29, 2015 1 / 28 Introduction Last time,

More information

Graduate Macroeconomics 2 Problem set Solutions

Graduate Macroeconomics 2 Problem set Solutions Graduate Macroeconomics 2 Problem set 10. - Solutions Question 1 1. AUTARKY Autarky implies that the agents do not have access to credit or insurance markets. This implies that you cannot trade across

More information

Economic Growth: Lectures 5-7, Neoclassical Growth

Economic Growth: Lectures 5-7, Neoclassical Growth 14.452 Economic Growth: Lectures 5-7, Neoclassical Growth Daron Acemoglu MIT November 7, 9 and 14, 2017. Daron Acemoglu (MIT) Economic Growth Lectures 5-7 November 7, 9 and 14, 2017. 1 / 83 Introduction

More information

General Equilibrium and Welfare

General Equilibrium and Welfare and Welfare Lectures 2 and 3, ECON 4240 Spring 2017 University of Oslo 24.01.2017 and 31.01.2017 1/37 Outline General equilibrium: look at many markets at the same time. Here all prices determined in the

More information

Lecture Notes: Math Refresher 1

Lecture Notes: Math Refresher 1 Lecture Notes: Math Refresher 1 Math Facts The following results from calculus will be used over and over throughout the course. A more complete list of useful results from calculus is posted on the course

More information

Foundations of Modern Macroeconomics B. J. Heijdra & F. van der Ploeg Chapter 6: The Government Budget Deficit

Foundations of Modern Macroeconomics B. J. Heijdra & F. van der Ploeg Chapter 6: The Government Budget Deficit Foundations of Modern Macroeconomics: Chapter 6 1 Foundations of Modern Macroeconomics B. J. Heijdra & F. van der Ploeg Chapter 6: The Government Budget Deficit Foundations of Modern Macroeconomics: Chapter

More information

Neoclassical Business Cycle Model

Neoclassical Business Cycle Model Neoclassical Business Cycle Model Prof. Eric Sims University of Notre Dame Fall 2015 1 / 36 Production Economy Last time: studied equilibrium in an endowment economy Now: study equilibrium in an economy

More information

Lecture 2: Firms, Jobs and Policy

Lecture 2: Firms, Jobs and Policy Lecture 2: Firms, Jobs and Policy Economics 522 Esteban Rossi-Hansberg Princeton University Spring 2014 ERH (Princeton University ) Lecture 2: Firms, Jobs and Policy Spring 2014 1 / 34 Restuccia and Rogerson

More information

Equilibrium Conditions and Algorithm for Numerical Solution of Kaplan, Moll and Violante (2017) HANK Model.

Equilibrium Conditions and Algorithm for Numerical Solution of Kaplan, Moll and Violante (2017) HANK Model. Equilibrium Conditions and Algorithm for Numerical Solution of Kaplan, Moll and Violante (2017) HANK Model. January 8, 2018 1 Introduction This document describes the equilibrium conditions of Kaplan,

More information

Knowing What Others Know: Coordination Motives in Information Acquisition

Knowing What Others Know: Coordination Motives in Information Acquisition Knowing What Others Know: Coordination Motives in Information Acquisition Christian Hellwig and Laura Veldkamp UCLA and NYU Stern May 2006 1 Hellwig and Veldkamp Two types of information acquisition Passive

More information

A simple macro dynamic model with endogenous saving rate: the representative agent model

A simple macro dynamic model with endogenous saving rate: the representative agent model A simple macro dynamic model with endogenous saving rate: the representative agent model Virginia Sánchez-Marcos Macroeconomics, MIE-UNICAN Macroeconomics (MIE-UNICAN) A simple macro dynamic model with

More information

Neoclassical Growth Model / Cake Eating Problem

Neoclassical Growth Model / Cake Eating Problem Dynamic Optimization Institute for Advanced Studies Vienna, Austria by Gabriel S. Lee February 1-4, 2008 An Overview and Introduction to Dynamic Programming using the Neoclassical Growth Model and Cake

More information

University of Warwick, EC9A0 Maths for Economists Lecture Notes 10: Dynamic Programming

University of Warwick, EC9A0 Maths for Economists Lecture Notes 10: Dynamic Programming University of Warwick, EC9A0 Maths for Economists 1 of 63 University of Warwick, EC9A0 Maths for Economists Lecture Notes 10: Dynamic Programming Peter J. Hammond Autumn 2013, revised 2014 University of

More information

ADVANCED MACRO TECHNIQUES Midterm Solutions

ADVANCED MACRO TECHNIQUES Midterm Solutions 36-406 ADVANCED MACRO TECHNIQUES Midterm Solutions Chris Edmond hcpedmond@unimelb.edu.aui This exam lasts 90 minutes and has three questions, each of equal marks. Within each question there are a number

More information

Behavioral Economics. Lecture 9

Behavioral Economics. Lecture 9 14.127 Behavioral Economics. Lecture 9 Xavier Gabaix April 8, 2004 1 Self Control Problems 1.1 Hyperbolic discounting Do you want a small cookie u s now (t 0 = 0) or a big cookie u b later (t 1 =1 week)?

More information

GMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p

GMM and SMM. 1. Hansen, L Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p GMM and SMM Some useful references: 1. Hansen, L. 1982. Large Sample Properties of Generalized Method of Moments Estimators, Econometrica, 50, p. 1029-54. 2. Lee, B.S. and B. Ingram. 1991 Simulation estimation

More information